Bingbot only pulls English version despite /zh/ being specified. Googlebot OK.

I am having difficulty having my Chinese site /zh/ indexed by Bing (and also Baidu) but Google is perfectly indexed.

I believe it’s because Bingbot (and Baidu) pulls the English version when it goes to my /zh/ site. I know this is happening because in Bing’s Webmaster Tool>>Diagnostics & Tools>>Fetch as Bingbot, my /zh/ site returns en-US and English site, not the Chinese. I also went to https://technicalseo.com/tools/fetch-render/ to pull my /zh/ site, and if I specified Bingbot, it pulls English version. But if I specified Google, it actually pulls Chinese correctly. Loading /zh/ site in any browser returns Chinese site, also in a mobile app like View Source.

I have written to Weglot support. They don’t know why my Chinese site is not being indexed. They claim that http://www.weglot.com/fr/ is correctly indexed in Bing, even though if you tried https://technicalseo.com/tools/fetch-render/ and specified Bingbot to pull http://www.weglot.com/fr/, it actually returns their English site instead of French too. I wonder if there are other reasons why Bing is able to index French version of http://www.weglot.com/fr/

Does anyone know the differences between Bing/Bingbot versus Google/Googlebot or a normal browser that could result in WordPress/Weglot always returning the English site to Bingbot?

Clearly Bingbot is communicating with WordPress/Weglot in a way that causes English version to be pulled, and this is different than any browser or Google.

Thank you!

• This topic was modified 4 years, 5 months ago by ngcheewe.

The page I need help with: [log in to see the link]