WordPress.org

Ready to get started?Download WordPress

Forums

Google XML Sitemaps
Early testers wanted (200 posts)

  1. avagogo
    Member
    Posted 3 years ago #

    Hi Arne - I've put this on a test site, and you can see the sitemaps here:
    http://www.investingguide.com.au/sitemap.xml
    http://www.investingguide.com.au/directory/sitemap.xml

    They look to be working correctly. I have a couple of questions though:
    1 - Do you know if there is any issue with Google if my site has two sitemaps? If so, have I set something up wrong? Or should I manually add the /directory home page url in the 'additional pages' section of the main site's sitemap settings?
    2 - I noticed that it no longer lists all links on one page, but links to sub-pages with the sitemap (eg. http://www.investingguide.com.au/sitemap-pages-2010-08.xml). Is that correct or have I also set this up wrong?

    Thank you so much for this plugin. I hope we're not causing you too many headaches!?!?

    Cheers, Rob

  2. oagostinho
    Member
    Posted 3 years ago #

    http://downloads.wordpress.org/plugin/google-sitemap-generator.4.0a4.zip

    I've just downloaded and extract to wordpress/wp-content/plugins/ but at dashboard - plugins i dont see it the plugin to activate it.

    Any Help? Thanks

  3. Aaron D. Campbell
    Member
    Posted 3 years ago #

    avagogo: Google is fine with you having multiple sitemaps. They even let you submit multiples to their Webmaster Tools.

    As for your other question, if you read through this thread Arne talks about WHY the plugin now uses multiple files.

  4. ihustleapps
    Member
    Posted 3 years ago #

    I tried using 4.0a4 and no urls would show up in the posts sitemap. I couldn't find any info to help debug why.

    I would also like to make a suggestion to have an option to split the sitemaps at X number of urls (50,000 ... 40,000 .. whatever you set).

    I have a site that I used csv importer to load up with posts and there are over 60,000 posts all listed under a single date. For me to submit this to google, this would have to be two sitemaps, not one for the whole month.

    It's also easy for alot of people to go over this limit (50,000), when you use plugins such as transposh, which replicates links 60x due to the permalinks for each translated language.

    Many thanks for all your hard work, where can I send a donation?

  5. Aaron D. Campbell
    Member
    Posted 3 years ago #

    ihustleapps: There's an option to donate on the plugin page.

  6. ryanmc
    Member
    Posted 3 years ago #

    Is this ready for a production site?

  7. LordZarcon
    Member
    Posted 3 years ago #

    firefox gave me an error of interpretation of the sitemap .. perhaps caused by a blank space .. so I added the "ob_clean ();" in line 10 of "sitemap-builder.php" to correct the error.

    now works perfectly:)

  8. qreus76
    Member
    Posted 3 years ago #

    LordZarcon

    Did your fix and it worked. But I think there still need to be a limit per sitemap option. Some sitemaps are being rejected by google because they are too big. Others are being rejected because it's taking too long to load.

    I'm trying this on about 10 of my sites. The smaller sites are passing with flying colors but the larger ones still have little issues. I am grateful though that at least it is partially accepted.

    BTW. Had to resubmit alot of them manually just to get google to update it's results.

  9. gudlyf
    Member
    Posted 3 years ago #

    I've installed the latest alpha release successfully, but it's behaving the same as the other versions for me, where I have a problem with the sitemap generation if done any other way than manually.

    Even using the GET request doesn't work. When I use that URL, it results in a blank page. When I go back to the XML Sitemaps settings, it reports the sitemap generation stopped after a little over 5000 entries (I have over 27000). If I click the "generate sitemap manually" link, it works perfectly. I'd LOVE at least the GET request to work, but it doesn't.

    I'll test whatever you want to get this working.

  10. Troy Cawley
    Member
    Posted 3 years ago #

    I am using this plugin on a multisite installation.

    It is working fine at the following addresses:
    http://troycawley.com/sitemap.xml
    http://family.troycawley.com/sitemap.xml
    http://maureencawley.com/sitemap.xml
    http://onemonthoff.com/sitemap.xml

    Caveats:
    There are no custom post types in any of these.
    They are relatively small blogs (< 20 posts in all of them, I think.)

    Hope this helps!

    Thank you, Arne for your great plugin!

  11. gudlyf
    Member
    Posted 3 years ago #

    I believe I've figured out my issue. If one builds manually -- not using the GET request -- it appears the script ignores any memory limitation settings. If you build automatically or via GET, it gets hit by memory limitations. Simply adding values into the memory usage limits and time limits fixed this.

  12. BAC
    Member
    Posted 3 years ago #

    using 4.a4 (not network activated)on wp 3.0 multisite with the domain mapping plugin.

    Seems to be working well, however, sitemap urls list use the subdomain rather than the mapped domain.

    Is there anyway of having the option to change the domain url - as i think you could in previous versions??

    cheers
    BAC

  13. Arnee
    Member
    Plugin Author

    Posted 3 years ago #

    Hi,

    sorry for the late reply, I'm a lot on the way at the moment and didn't have time to improve the plugin. I've committed a new version to the repository, please have a look if your problems are fixed now.

    http://downloads.wordpress.org/plugin/google-sitemap-generator.4.0a5.zip

    Major change: The plugin is now PHP 5.1+ ONLY. I will not continue to support PHP4 on version 4+ of this plugin. If you activate it using PHP < 5.1 or WP < 2.8, you will only see a notification bar which recommends you to upgrade. PHP4 is really bad in memory handling and objects and supporting PHP4 will break some things with PHP 5.3.

    Custom post types are not ready yet, this will be the next feature. For now I want to get the rest of the plugin stable. Please let me know if there are still problems.

    Thank you very much for testing!!!

    @LordZarcon: What error did you see in Firefox? Does the new version fix this issue?

    @qreus76: Google says your sitemap is too big? With the new splitting, you would need more than 50.000 posts in one month to hit the limit?

    @gudlyf: Sure you updated to the new alpha version? There is no link to "generate sitemap manually" anymore. The sitemap is always generated on the fly.

    @BAC: I didn't try to domain mapper plugin yet, but the links are coming from the get_permalink function of WordPress, which the domain mapper plugin should modify... I will have a look...

  14. gudlyf
    Member
    Posted 3 years ago #

    @arnee --

    Yes, and I just updated to this version and, as you can see, the link to generate manually is still there:

    http://skitch.com/gudlyf/d3ugy/xml-sitemap-generator-cliqueclack-tv-wordpress-build-20100914120618

  15. Arnee
    Member
    Plugin Author

    Posted 3 years ago #

    gudlyf, that is strange. The links are definitely not there anymore in the new alpha versions. Looks like you have a new sitemap.php and so on, but the sitemap-ui.php file is still the same.

    Can you try to deactivate the plugin, delete the whole plugin folder and upload the new version again?

  16. gudlyf
    Member
    Posted 3 years ago #

    @arnee -- Found the issue. Sorry I didn't check it sooner. I had to restart PHP-FPM, which had stored those files in memory. Once I did that, the new UI appeared.

    However, now I have a different issue. The smaller sites I have seem to generate the sitemap files just fine:

    http://cliqueclack.com/food/sitemap.xml

    The largest one does not, and I'm not sure where to debug it:

    http://cliqueclack.com/tv/sitemap.xml

  17. gudlyf
    Member
    Posted 3 years ago #

    OK, it appears I "fixed" this by just forcing things along with a non-permalink visit to the sitemap. Once that was done, the permalink worked. *shrug*

  18. gudlyf
    Member
    Posted 3 years ago #

    Spoke too soon. Well, this is a different error.

    Our site has a LOT of tags. When trying to use the sitemap-tags.xml file, it bombs:

    Fatal error: Allowed memory size of 67108864 bytes exhausted (tried to allocate 262144 bytes) in /home/www/cliqueclack.com/public/wp-includes/taxonomy.php on line 2269

    This didn't happen with the older plugin. Tried increasing memory in the options for the plugin, but did no good. For now, to get it working at least somewhat, I turned off tag sitemaps for this one site. That is working so far, but it's not mapping those pages anymore.

  19. Arnee
    Member
    Plugin Author

    Posted 3 years ago #

    Hi,

    I just check your site and saw this too. Can you give me a number about how many tags you have? I have several testing blogs with dummy data and was trying them out before. One of them has around 1000 tags and needs 21MB. 18MB is already the WordPress base, so generating the tag page needs only 3MB.

    Also the way the tags are retrieved didn't really change... Do you have any other plugins running which could interfere with the tags?

    It would be good to know what causes the memory usage. Is it the building of the permalinks or the tag query? For that you can open the sitemap-builder.php and search for the "BuildTags" function. Comment out the "$gsg->AddUrl..." line and see how much memory it uses now. Of course the page will be empty, but the memory usage should be visible in the source code. Thanks!

  20. gudlyf
    Member
    Posted 3 years ago #

    We're talking over 20k tags. I got around the issue by increasing the maximum script size in php.ini, so I'm all set.

    One other thing I noticed: it appears archive sitemaps are broken. When I tried that, the urls it gave for the archive sitemaps did not end with 'sitemap.xml'. I turned off archives for now.

  21. gudlyf
    Member
    Posted 3 years ago #

    Here's the link, so you can see what I mean:

    http://cliqueclack.com/tv/sitemap-archives.xml

    Same for other sites:

    http://cliqueclack.com/food/sitemap-archives.xml

  22. Arnee
    Member
    Plugin Author

    Posted 3 years ago #

    20k? Ok thats a lot... The problem is that WordPres tries to cache everything, the query result, the objects and so on. So there will be probably a few 20k arrays in the memory somewhere.

    For me the archives look fine? They should point to the WP archives like http://wordpress.org/news/2010/09/

  23. gudlyf
    Member
    Posted 3 years ago #

    Ah, I see. My problem is I don't handle archives with my theme properly. So, turning them off is just fine. :)

  24. Aaron D. Campbell
    Member
    Posted 3 years ago #

    @arnee - The custom post type functionality was so close! Those minor fixes that I did (and I posted the code here in the thread) fixed it completely on my site. If you need help getting that functionality working, just let me know. I'm pretty busy, but I'm sure I can find time to get you a patch.

    As of now though, I'm sticking with my modified version of your alpha-4 release, because 95% of the content on my new site are custom post types.

  25. tetele
    Member
    Posted 3 years ago #

    Really looking forward to those custom posts :D

  26. vlp
    Member
    Posted 3 years ago #

    me too:)

    aaroncamplbell: could you maybe share your modified version?

  27. marcfonteijn
    Member
    Posted 3 years ago #

    I've been testing 4.0a5 on a wordpress install with over >180k posts and I'm impressed by the stability and speed already! The only time it breaks is on a few months with >10k posts. I get a "XML Parsing Error: no element found" error on those months. Is there a way I can help with some debug info?

  28. Aaron D. Campbell
    Member
    Posted 3 years ago #

    @vlp: my changes were posted previously in this thread.

  29. Mitch
    Member
    Posted 3 years ago #

    I have downloaded the latest 4.0a5 and could not get it to generate a Site map. I edited two posts and updated no sitemap.

    after plugin was activated i realized I tried the 4.01a version a while ago and that did not work either then I switched to simple sitemap and that worked but I rather use yours.
    WP3.01 multisite.
    url to site http://bloginsphere.com

  30. Arnee
    Member
    Plugin Author

    Posted 3 years ago #

    Aaron, thank you very much again for your changes. I will integrate them later for sure!

    n2rga, could you give me more details about what exactly didn't work? What happened when you tried to access the sitemap?

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic