Title: Robots.txt
Last modified: September 1, 2016

---

# Robots.txt

 *  Resolved [eddyferns](https://wordpress.org/support/users/eddyferns/)
 * (@eddyferns)
 * [9 years, 11 months ago](https://wordpress.org/support/topic/robotstxt-49/)
 * Hi Ninja Support,
 * It is a well-known security measure to have a Robots.txt either as a whitelist
   or blacklist.
 * So is it necessary to have this text file or will the Ninjafirewall protection
   suffice given the new bad bots that are released regularly?
 * Thanks,
    Ed
 * [https://wordpress.org/plugins/ninjafirewall/](https://wordpress.org/plugins/ninjafirewall/)

Viewing 3 replies - 1 through 3 (of 3 total)

 *  Plugin Author [nintechnet](https://wordpress.org/support/users/nintechnet/)
 * (@nintechnet)
 * [9 years, 11 months ago](https://wordpress.org/support/topic/robotstxt-49/#post-7568004)
 * Hi,
 * Bad bots will not follow your robots.txt file.
    NinjaFirewall will block a lot
   of them.
 *  Thread Starter [eddyferns](https://wordpress.org/support/users/eddyferns/)
 * (@eddyferns)
 * [9 years, 10 months ago](https://wordpress.org/support/topic/robotstxt-49/#post-7568079)
 * Okay. But does Ninjafirewall generate a robots.txt file of its own?
 * I did not create any robots.txt file.
 * After adding robots.txt at the end of the url I get the below code on the page:
 * User-agent: *
    Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php
 *  Plugin Author [nintechnet](https://wordpress.org/support/users/nintechnet/)
 * (@nintechnet)
 * [9 years, 10 months ago](https://wordpress.org/support/topic/robotstxt-49/#post-7568081)
 * No, it does not generate any robots.txt.

Viewing 3 replies - 1 through 3 (of 3 total)

The topic ‘Robots.txt’ is closed to new replies.

 * ![](https://ps.w.org/ninjafirewall/assets/icon-256x256.png?rev=976137)
 * [NinjaFirewall (WP Edition) - Advanced Security Plugin and Firewall](https://wordpress.org/plugins/ninjafirewall/)
 * [Frequently Asked Questions](https://wordpress.org/plugins/ninjafirewall/#faq)
 * [Support Threads](https://wordpress.org/support/plugin/ninjafirewall/)
 * [Active Topics](https://wordpress.org/support/plugin/ninjafirewall/active/)
 * [Unresolved Topics](https://wordpress.org/support/plugin/ninjafirewall/unresolved/)
 * [Reviews](https://wordpress.org/support/plugin/ninjafirewall/reviews/)

 * 3 replies
 * 2 participants
 * Last reply from: [nintechnet](https://wordpress.org/support/users/nintechnet/)
 * Last activity: [9 years, 10 months ago](https://wordpress.org/support/topic/robotstxt-49/#post-7568081)
 * Status: resolved