Including robots.txt and rewriting sitemap URL
-
I’m including a site’s robots.txt file using the “Additional URLs” setting. However the sitemap URL is not being rewritten. Perhaps you could add a hook at the beginning of the extract_and_update_urls function, so unsupported file types could be handled?
Viewing 2 replies - 1 through 2 (of 2 total)
Viewing 2 replies - 1 through 2 (of 2 total)
- The topic ‘Including robots.txt and rewriting sitemap URL’ is closed to new replies.