Robots.txt

Viewing 3 replies - 1 through 3 (of 3 total)
  • Plugin Author nintechnet

    (@nintechnet)

    9 years, 11 months ago

    Hi,

    Bad bots will not follow your robots.txt file.
    NinjaFirewall will block a lot of them.

    Thread Starter eddyferns

    (@eddyferns)

    9 years, 10 months ago

    Okay. But does Ninjafirewall generate a robots.txt file of its own?

    I did not create any robots.txt file.

    After adding robots.txt at the end of the url I get the below code on the page:

    User-agent: *
    Disallow: /wp-admin/
    Allow: /wp-admin/admin-ajax.php

    Plugin Author nintechnet

    (@nintechnet)

    9 years, 10 months ago

    No, it does not generate any robots.txt.

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘Robots.txt’ is closed to new replies.