Title: Crawler Check Last modified: April 8, 2023 --- # Crawler Check * Resolved [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 12 months ago](https://wordpress.org/support/topic/crawler-check/) * Hello, would like to get your opinion on this: * Report number: ABXICUKK * Report date: 04/08/2023 12:47:37 1. Every time I run a manual crawl, it always results in blue. That does mean I am not caching properly because I haven’t had a green result even once. I noticed, my pages only get fast after the third visit. Then after 5 minutes, if I visit the same page again – it feels like a first visit because it has to load for a while. [https://prnt.sc/ZozW0Gkzx9NJ](https://prnt.sc/ZozW0Gkzx9NJ) 2. For the Watch Status, can this be interpreted as working? [https://prnt.sc/H_4wXpVGtE_J](https://prnt.sc/H_4wXpVGtE_J) * There’s only position 1 but I have lots of links to crawl. I saw some examples and I see positions 27, 5, etc. Is position means URL? * 3. This is the result I get as well. All blue and there are 404 and 403: [https://prnt.sc/ADyByHmTsNgg](https://prnt.sc/ADyByHmTsNgg) * Thank you. Viewing 15 replies - 1 through 15 (of 18 total) 1 [2](https://wordpress.org/support/topic/crawler-check/page/2/?output_format=md) [→](https://wordpress.org/support/topic/crawler-check/page/2/?output_format=md) * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [2 years, 12 months ago](https://wordpress.org/support/topic/crawler-check/#post-16639064) * please go to LiteSpeed Cache -> General -> Server IP * leave it empty or use IPv4 addr * Thread Starter [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 12 months ago](https://wordpress.org/support/topic/crawler-check/#post-16639193) * [@qtwrk](https://wordpress.org/support/users/qtwrk/) Thank you very much. It is now working and I can evidently see and feel the speed of my pages. These are my crawlers [https://prnt.sc/BQNDt-Cq3yqN](https://prnt.sc/BQNDt-Cq3yqN) and my website is a private community mostly for logged-in users. * Does it make sense to turn off the Guest crawlers? I only need my homepage to be cached for guests or is homepage automatically cached? * Thank you. * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [2 years, 12 months ago](https://wordpress.org/support/topic/crawler-check/#post-16640545) * no , guest crawler is something else, that’s for the feature `Guest Mode` , for login user you need to use ESI + role simulation * Thread Starter [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 12 months ago](https://wordpress.org/support/topic/crawler-check/#post-16640621) * Thank you. * How about the mobile caching? I do have a mobile app created using BuddyBoss and it has pages that opens via Webview. * If Mobile Cache is **disabled**, webview is caching the webview page after 2 visits. But caching is lost once the app is closed. * If Mobile Cache is **enabled**, there is no webview caching at all. * Is there a proper configuration to make this work? Thank you. * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16646532) * I am not familiar with mobile app thing * how exactly does that work ? it’s like headless client ? or just browser-like app that dedicated to your URL only ? * Thread Starter [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16660067) * Hello, * It’s an app built using BuddyBoss ([https://www.buddyboss.com/mobile-app/](https://www.buddyboss.com/mobile-app/)) * It’s built using React Native. There are native pages and there are pages as well that can open as “Webview”. It’s like a web browser inside the app. * The Webview pages only caches after 2 or 3 visits, and when the app was closed– it’s like the cache resets. * **I have sent login credentials to test the app via:** - Report number: IYPZEEPP - Report date: 04/17/2023 01:29:00 * **To Test: Go To More > Dashboard** - On first visit, it loads around ~3 secs. - On second visit, it loads around ~3 secs. - On third visit, it loads around ~1.5secs. - And when the app is closed, the cache is gone and would load ~3 secs again. * Thank you. * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16663466) * hmmmm? I wonder what does it request to ? * like a headless WP REST response and then use app to form the page ? please try obtain the URIs it requested to * Thread Starter [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16699664) * Hello [@qtwrk](https://wordpress.org/support/users/qtwrk/) * Here’s the response I got for this from BuddyBoss Support: * I understand your concern regarding the issue you are facing. I have checked on the issue and found that the web view in the app is being processed through the use of a query parameter in the URL. For example, if the web-view URL is “ [https://example.com,](https://example.com%2C/)” it’s accessed via the app as a URL of “[https://example.com/?mobile-page-mode=1](https://example.com/?mobile-page-mode=1)“. if LiteSpeed can allow caching on query parameters like this, we hope the pages will also be cached when accessed via the app. * What do you think [@qtwrk](https://wordpress.org/support/users/qtwrk/) ? Thank you. * Thread Starter [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16724430) * [@qtwrk](https://wordpress.org/support/users/qtwrk/) Hi, any opinion on this? Thanks * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16724432) * what do you see if you access any page with [`?mobile-page-mode=1`](https://example.com/?mobile-page-mode=1)? * Thread Starter [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16724453) * It’s a normal page. Within an app, it’s called Webview. [https://www.kirupa.com/apps/webview.htm](https://www.kirupa.com/apps/webview.htm) * Pages within a webview are not being cached unlike pages in a desktop browser or mobile browers. * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16724454) * please try enable debug log with that `mobile-page-mode` as debug include URI and access it by app , then check the log , the log will tell what was going on * Thread Starter [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16724471) * I got the logs [@qtwrk](https://wordpress.org/support/users/qtwrk/) . Is it okay to post it here? * Plugin Support [qtwrk](https://wordpress.org/support/users/qtwrk/) * (@qtwrk) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16724486) * [https://paste.ubuntu.com/](https://paste.ubuntu.com/) * you can put it here and share the link , you may strip any sensitive info like your IP or site domain if you wish. * Thread Starter [aaronwp03](https://wordpress.org/support/users/aaronwp03/) * (@aaronwp03) * [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/#post-16724505) * Here it is [@qtwrk](https://wordpress.org/support/users/qtwrk/) * [https://paste.ubuntu.com/p/2k3z7kcwTq/](https://paste.ubuntu.com/p/2k3z7kcwTq/) Viewing 15 replies - 1 through 15 (of 18 total) 1 [2](https://wordpress.org/support/topic/crawler-check/page/2/?output_format=md) [→](https://wordpress.org/support/topic/crawler-check/page/2/?output_format=md) The topic ‘Crawler Check’ is closed to new replies. * ![](https://ps.w.org/litespeed-cache/assets/icon-256x256.png?rev=2554181) * [LiteSpeed Cache](https://wordpress.org/plugins/litespeed-cache/) * [Frequently Asked Questions](https://wordpress.org/plugins/litespeed-cache/#faq) * [Support Threads](https://wordpress.org/support/plugin/litespeed-cache/) * [Active Topics](https://wordpress.org/support/plugin/litespeed-cache/active/) * [Unresolved Topics](https://wordpress.org/support/plugin/litespeed-cache/unresolved/) * [Reviews](https://wordpress.org/support/plugin/litespeed-cache/reviews/) ## Tags * [crawler](https://wordpress.org/support/topic-tag/crawler/) * 18 replies * 2 participants * Last reply from: [qtwrk](https://wordpress.org/support/users/qtwrk/) * Last activity: [2 years, 11 months ago](https://wordpress.org/support/topic/crawler-check/page/2/#post-16724525) * Status: resolved