Title: Is crawler working
Last modified: January 3, 2020

---

# Is crawler working

 *  Resolved [zenjameo](https://wordpress.org/support/users/zenjameo/)
 * (@zenjameo)
 * [6 years, 4 months ago](https://wordpress.org/support/topic/is-crawler-working/)
 * Hello,
 * We are using LS + Cache.
    Crawler was activated using this topic [https://www.litespeedtech.com/support/wiki/doku.php/litespeed_wiki:cache:lscwp:configuration:enabling_the_crawler](https://www.litespeedtech.com/support/wiki/doku.php/litespeed_wiki:cache:lscwp:configuration:enabling_the_crawler)
 * Trying to make sure crawler is working, but seams something is wrong.
 * from $_SERVER[‘X-LSCACHE’] I see crawler is ON (on,crawler)
 * But in WP plugin I don`t see any changes.
    1. Noticed on forum there should be
   button RUN MANUALLY. 2. Don`t see button to Turn crawler ON/OFF
 * Also, is there any crawler log?

Viewing 6 replies - 1 through 6 (of 6 total)

 *  Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/)
 * (@qtwrk)
 * [6 years, 4 months ago](https://wordpress.org/support/topic/is-crawler-working/#post-12289550)
 * Hi,
 * Could you please check that if you see this ?
 * > [View post on imgur.com](https://imgur.com/P0Gjymj)
 * yes, crawler log should be in /wp-content/crawler.log
 * Best regards,
 *  Thread Starter [zenjameo](https://wordpress.org/support/users/zenjameo/)
 * (@zenjameo)
 * [6 years, 4 months ago](https://wordpress.org/support/topic/is-crawler-working/#post-12289728)
 * Found this, thank you. Was looking in settings at first.
 * > [View post on imgur.com](https://imgur.com/P0Gjymj)
 * No crawler log yet. Seams to me something is wrong with my sitemap format.
    Once
   I click “Manually run” it stops in a second (sitemap is 13k urls).
 * I`m using a custom sitemap URL. Regular format:
 *     ```
       <urlset>
       <url>
       <loc>https://domain.com/accountants/cyprus/</loc>
       <lastmod>2020-01-03</lastmod>
       <changefreq>monthly</changefreq>
       <priority>0.9</priority>
       </url>
       ```
   
 * any advice?
 * Before this I was trying to crawl Yoast sitemap
    [http://joxi.ru/VrwlRMgf7dZEom](http://joxi.ru/VrwlRMgf7dZEom)
   also no success.
 *  [stanley@litespeed](https://wordpress.org/support/users/stanleylitespeed/)
 * (@stanleylitespeed)
 * [6 years, 4 months ago](https://wordpress.org/support/topic/is-crawler-working/#post-12290357)
 * When you click “Manually run” do you find any output and error message from `
   Watch Crawler Status`?
 *  Thread Starter [zenjameo](https://wordpress.org/support/users/zenjameo/)
 * (@zenjameo)
 * [6 years, 4 months ago](https://wordpress.org/support/topic/is-crawler-working/#post-12290720)
 * Output looks like this after a 1 second:
    [http://joxi.ru/MAjlgpYfj7z0dm](http://joxi.ru/MAjlgpYfj7z0dm)
 *     ```
           Start watching...
           Manually Started
           .......
       ```
   
 *  [stanley@litespeed](https://wordpress.org/support/users/stanleylitespeed/)
 * (@stanleylitespeed)
 * [6 years, 4 months ago](https://wordpress.org/support/topic/is-crawler-working/#post-12296821)
 * Do you find any Sitemap Generation Blacklist? Also, does the sitemap’s URL `https://
   domain.com` exact match with your site’s URL?
 *  Plugin Support [LiteSpeed Lisa](https://wordpress.org/support/users/lclarke/)
 * (@lclarke)
 * [6 years, 4 months ago](https://wordpress.org/support/topic/is-crawler-working/#post-12320079)
 * Hi,
 * I’m going to mark this topic “Resolved,” due to lack of activity.
 * If you still need help, please provide the previously requested information.
 * We’ll be happy to reopen the topic if necessary.
 * Thanks!

Viewing 6 replies - 1 through 6 (of 6 total)

The topic ‘Is crawler working’ is closed to new replies.

 * ![](https://ps.w.org/litespeed-cache/assets/icon-256x256.png?rev=2554181)
 * [LiteSpeed Cache](https://wordpress.org/plugins/litespeed-cache/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/litespeed-cache/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/litespeed-cache/)
 * [Active Topics](https://wordpress.org/support/plugin/litespeed-cache/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/litespeed-cache/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/litespeed-cache/reviews/)

 * 6 replies
 * 4 participants
 * Last reply from: [LiteSpeed Lisa](https://wordpress.org/support/users/lclarke/)
 * Last activity: [6 years, 4 months ago](https://wordpress.org/support/topic/is-crawler-working/#post-12320079)
 * Status: resolved