Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without…
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without…
rexCrawler is a regular expression web-crawler plugin. Able to parse websites, save data and show…
This plugin detects a few bots (e.g. Google, Google ads, Alta vista etc) and sends…
With SEObot Monitor for Googlebot you will be able to dump the server logs to…
Display the results of your Page Modified crawls right within your WordPress Admin.