Your sitemap is here: https://www.askedon.com/sitemap_index.xml
We manually reviewed your homepage and can confirm that is has a single H1 heading and a few subheadings (h2 and h3).
I did a cURL (it’s a request like a bot would do when reviewing code) and your server returns an error page. This typically means that something prevents “bad” bots from viewing the page. Do you have any security plugins that block access to bots? If so, does temporarily disabling the blocking feature allow the tools to see your site correctly.
Thank you so much for your help. Yes I am using sitelock security.
I have a question which I hope you will answer.
Will this prevention of bots (bad bots) affect my blog SEO?
Hi,
If you know there are certain bad bots crawling your site and you do not want these to, it is OK to add rules in your robots.txt file to prevent them from doing so.This guide explains more about how to edit the file: https://kb.yoast.com/kb/how-to-edit-robots-txt-through-yoast-seo/.
If you are not sure what rules to add, your host provider may be able to help.
-
This reply was modified 4 years, 5 months ago by
Pcosta88.
-
This reply was modified 4 years, 5 months ago by Pcosta88.
It could affect site indexing, …
You can see:
$ curl "https://www.askedon.com/sitemap_index.xml"
<html>
<head>
<META NAME="robots" CONTENT="noindex,nofollow">
<script src="/_Incapsula_Resource?SWJIYLWA=5074a744e2e3d891814e9a2dace20bd4,719d34d31c8e3a6e6fffd425f7e032f3">
</script>
<body>
</body></html>
$ curl "https://www.askedon.com/sitemap_index.xml" -H "Cookie: incap_ses_763_2183065=6llwZDzmQzeeBBg1irmWCt6P4V0AAAAAJkuzNZl5f2/s86aSRGM67w=="
<?xml version="1.0" encoding="UTF-8"?><?xml-stylesheet type="text/xsl" href="//www.askedon.com/wp-content/plugins/wordpress-seo/css/main-sitemap.xsl"?>
Bots often don’t process first HTML and they can’t set properly cookie which enable access to your site. In this case “many bots” see “empty page” instead of real content.
It seems that your site is behind “Incapsula web firewall” and it could block bots which checks your site (SEO service which you have tried) and even regular bots as GoogleBot.
You need to contact your host for more details. I find some FAQ which could help you to set access for some bots – https://support.incapsula.com/hc/en-us/articles/200627690-Bot-Access-Control-Tool
I don’t have experience with this tool, so we can’t help more.
Saša Thank you so much for such a detail answer.
As this topic appears to be resolved we will close it to keep the overview. If needed feel free to open up a new topic if you experience a different issue.
