Can you please confirm if all the steps suggested in this article are followed? https://yoast.com/cloak-affiliate-links/
Respected jerparx (@jerparx)
Yes i followed everything correctly none of the bots is allowed to fetch the details inside my folder /go/ or /out/ folder but my website link they can crawled . means they can’t crawl the content or link inside that /go/ or /out/ folder . If we will add no follow to the link on post then only google will not crawl my own website link (myexample.com/go/seoplugin) . I hope i am able to convey my message to you . Sorry if my English is broken .
So should i add no follow link to my website (myexample.com/go/seoplugin) link means no follow to myexample.com/go/seoplugin . i know we have already blocked the content inside but still google might think like he may be spamming system
Regards,
Rahul
Google crawls all links on your site. The ‘Blocked’ label means that something (in this case the robots file) prevents Google from the link. This is expected behavior when you block a link that you use on your site.
Learn more about the ‘Blocked’ label here.
Respected team ,
Sorry to disturb you again . But i need to ask you one small question . Hope team won’t mind in giving reply for this small question
This is the screenshot of https://prnt.sc/mdkw6g webmaster blocked link .
When trying to fetch any /go/ link https://www.gomahamaya.com/go/yoast on redirectcheck.com/index.php then it shows what is there in that blocked link . But according to robots.txt file i have blocked all bots . Still they are able to fetch data .
But when i try other website data with link /go/ they show bots are not allowed to fetch data .
So my question is am i doing any thing wrong in cloaking links ? do i have to add something more on my website ? Do i have to add any special header function to my website ?
While searching on google i found this code
$url = “//{$_SERVER[‘HTTP_HOST’]}{$_SERVER[“REQUEST_URI”]}”;
if (preg_match(“#/go/#”, $url))
{
header( “X-Robots-Tag: noindex, nofollow”, true );
header( “Cache-Control: private”, true );
}
Should i add above code to my website Or any special header code i have to add via .htacess file . Yoast always recommend to add header code via .htacess instead of function.php .
So i will request you to help me on this topic . Any help will be much appreciated .
Regards,
Rahul