WordPress.org

Author: Akshay Raje

An easy to implement professional web scraper for WordPress. This can be used to display realtime data from any websites directly into your posts, pages or sidebar. Use this to include realtime stock quotes, cricket or soccer scores or any other generic content. The scraper is built using timetested libraries cURL for scraping and phpQuery for parsing HTML. Features include:

1. Can be easily implemented using the button in the post / page editor.
2. Configurable caching of scraped data. Cache timeout in minutes can be defined in minutes for every scrap.
3. Custom Useragent header for your scraper can be set for every scrap.
4. Scrap output can be displayed thru custom template tag, shortcode in page, post and sidebar (text widget).
5. Other configurable settings like cURL timeout, disabling shortcode etc.
6. Error handling - Silent fail, standard error, custom error message or display expired cache.
7. Option to clear or replace a certain regex pattern from the scrap before output.
8. Built-in module for stock market data (NSE, BSE and NASDAQ supported currently), other markets to follow. For example - [wpws_market_data market="NSE" symbol="ACC" datatype="last"] will output the latest price of ACC on NSE. Refer FAQs for more details of this shortcode API.

For demos and support, visit the WP Web Scraper project page. Comments appriciated.

Looking for an easy to use API for free Stock Market feeds (RSS, JSON etc)? Try out a prototype API which I am working on, visit http://smdapi.co.cc for further details.