You should double-check your permalinks settings.
Hi, I’ve checked my permalinks and everything seems fine.
They’re set at Month and name
The strange thing is, all new posts get added to Google fine.
The only thing I can remember doing is when we initially setup WordPress, we chose not to have the blog visible and uploaded about 1,000+ articles. Then we had it go live and made it visible.
Does anyone know how we can check into this further……or is there something I am missing?
Still nothing.
Google is only indexing anything new we put on the site.
Does anyone have a solution?
What are we doing wrong?
What’s in your robots.txt file? Are you blocking parts of the site in your robots.txt file even though you have meta tags that ask for “follow, all?” Or in .htaccess?
Things look okay to me, and if these URLs are truly 404, then Google will eventually drop them and index the correct URLs. It could be that someone was experimenting around with pretty permalinks settings when Google happened to schedule a full crawl of your site, resulting in lots of 404s.
But can’t Google index the correct pages before it removes the old pages?
Also, how often does Google crawl sites?
I don’t think we’re blocking anything in robots.txt that is out of the ordinary.
As I said, everything that goes onto the site now gets indexed by Google, but when we had the site “hidden” it seems all of those posts are not indexed.
You can g to your Google account, sitemap settings, and crank up the crawl rate to one page per 30 seconds, or better. Google will crawl/recrawl your site much faster. Works for my sites.
BTW, even with a sitemap, Google will not index every page from a larger site if that site is new or has low PageRank.
That makes sense; I’ve got fairly high PageRanks gained over the years, with lots of content, and I guess as a result, Google will crawl my sites fast when I turn up the crawl rate.
Yes I did crank up the crawl rate to MAX about 1 week ago or more.
Not sure if that made a difference.
One thing I did notice was that the number of Not Found pages has decreased.
But…..the number of indexed posts hasn’t changed. Why?
Is there anything I can do to fix this problem ASAP?
For removing 404s, see: http://www.google.com/support/webmasters/bin/answer.py?answer=61062
As for increasing the number of indexed pages, time and increased PageRank will help.
Thanks, I’ll start removing the 404’s.
Do you know how long it takes?
Also, what do you mean by “time and increased PageRank will help”
How do we do this?
