WordPress.org

Plugin Directory

WP Web Scraper

An easy to implement web scraper for WordPress. Display realtime data from any websites directly into your posts, pages or sidebar.

An easy to implement web scraper for WordPress. This can be used to display realtime data from any websites directly into your posts, pages or sidebar. Use this to include realtime stock quotes, cricket or soccer scores or any other generic content. Features include:

  1. Scrap output can be displayed thru custom template tag, shortcode in page, post and sidebar (through a text widget).
  2. Configurable caching of scraped data. Cache timeout in minutes can be defined in minutes for every scrap.
  3. Configurable Useragent for your scraper can be set for every scrap.
  4. Configurable default settings like enabling, useragent, timeout, caching, error handling.
  5. Multiple ways to query content - CSS Selector, XPath or Regex.
  6. A wide range of arguments for parsing content.
  7. Option to pass post arguments to a URL to be scraped.
  8. Dynamic conversion of scrap to specified character encoding to scrap data from a site using different charset.
  9. Create scrap pages on the fly using dynamic generation of URLs to scrap or post arguments based on your page's get or post arguments.
  10. Callback function for advanced parsing of scraped data.

Check the the official website wp-ws.net for documentation, browse through examples, or try paid support for crafting a perfectly optimized web scrape.

Requires: 2.8 or higher
Compatible up to: 4.1.7
Last Updated: 2015-3-30
Active Installs: 3,000+

Ratings

4.4 out of 5 stars

Support

0 of 3 support threads in the last two months have been resolved.

Got something to say? Need help?

Compatibility

+
=
Not enough data

0 people say it works.
0 people say it's broken.

100,1,1
100,1,1 0,1,0
100,1,1
0,2,0 100,1,1
100,1,1
100,1,1 100,1,1
0,1,0
100,1,1 100,1,1
100,1,1
0,3,0
100,1,1
67,3,2
33,3,1
0,1,0
0,1,0
0,3,0
100,1,1
100,2,2
100,1,1 100,1,1 100,1,1
100,1,1