Why Robots.txt Preview different when in /robots.txt ?

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Support Shivam Tyagi

    (@shivamtyagi)

    1 year ago

    Hi @71mm0,

    Would it be possible for you to FTP to your server and check for any static robots.txt files?

    Could you also please use the Health Check & Troubleshooting plugin (https://wordpress.org/plugins/health-check/) to cancel out any possible plugin/theme conflicts by following these steps:

    The testing will not affect the site for your visitors.

    1. Go to Plugins > Add New and install and activate the Health Check & Troubleshooting plugin.
    2. Please be sure to have a default WordPress theme like Twenty Twenty installed.
    3. Go to Plugins > Installed Plugins and click on Troubleshoot below the All in One SEO plugin.
    4. This will temporarily disable all the plugins and switch to a default theme only for your user ID without impacting what your visitors see.
    5. Check to see if you’re able to reproduce the problem. If not, then enable your theme under Troubleshooting Mode. You can then test each plugin there as well.
    6. Once you’re done troubleshooting, deactivate and delete the Health Check & Troubleshooting plugin.

    Please let me know what you find.

    Thread Starter Jimmy Ahyari

    (@71mm0)

    1 year ago

    Hi @shivamtyagi ,

    Would it be possible for you to FTP to your server and check for any static robots.txt files?

    There is no static/physical file of robots.txt. Because usually if there is, there will be a warning from your plugin.

    If I change the contents of robots.txt, the preview and /robots.txt will also change, except for the sitemap section. In the preview the sitemap always appears. And never once has the sitemap appeared in /robots.txt

    If it’s too weird like this, it’s easier to create/use and write directly to a physical file. How to disable robots.txt from you? so that when I create a physical file and it exists, your plugin doesn’t make a fuss about notifying that there is a physical robots.txt file?

    edit: oh i found it to disable your robots txt, just toggle switch off custom robots.txt and press x button in right up corner if notification show up tell import or delete physical robots.txt.

    Does not matter. I wouldn’t have to waste time troubleshooting if it was just as simple as creating a physical file.

    Thanks

    • This reply was modified 1 year ago by Jimmy Ahyari. Reason: add info
    Plugin Support Shivam Tyagi

    (@shivamtyagi)

    1 year ago

    Hi @71mm0 ,

    I understand your choice to use a static robots.txt file for now. However, if you decide to switch back to the dynamic robots.txt file generated by WordPress and managed by AIOSEO and face issues, please follow the troubleshooting steps I shared earlier.

    This will help identify any plugin/theme conflicts or issues specific to your site or hosting environment. We’re here to assist and ensure a smooth experience with our plugin. Please let us know if you have any questions or if we can help in any other way.

Viewing 3 replies - 1 through 3 (of 3 total)
  • The topic ‘Why Robots.txt Preview different when in /robots.txt ?’ is closed to new replies.