WordPress.org

Ready to get started?Download WordPress

Forums

FeedWordPress
Repeat posts on every update (46 posts)

  1. Zepfanman
    Member
    Posted 2 years ago #

    Approximately since I upgraded to WP 3.1.3 a couple days ago, Feedwordpress 2011.0512 has been importing the same posts from all of my feeds over and over again every time it updates. It is not recognizing that posts have already been created. What are the best diagnostic options to check to see what's going on?

    http://wordpress.org/extend/plugins/feedwordpress/

  2. niska
    Member
    Posted 2 years ago #

    I have the same problem!

    It seems as if GUID is gone :-(

    I'll try to downgrade wordpress...

  3. niska
    Member
    Posted 2 years ago #

    Downgrading WordPress to 3.1.2 solved it for me. I'm not sure about what is the problem.

  4. niska
    Member
    Posted 2 years ago #

    If anyone has a suggestion on how to delete all posts (and postmeta) for all duplicates, please tell. A sql-query would be nice.

  5. niska
    Member
    Posted 2 years ago #

    I think Hotfix will solve it:

    http://wordpress.org/extend/plugins/hotfix/

    There is a bug in 3.1.3.

  6. Zepfanman
    Member
    Posted 2 years ago #

    Hmm, Hotfix doesn't fix it for me. I was hoping I wouldn't have to downgrade as I'm not very good with MySQL manipulation. Seems to be the only solution at this point though. Is this a good procedure? http://www.cleverlight.net/blog/easy-wordpress-downgrade.html

  7. sygnin
    Member
    Posted 2 years ago #

    Hi

    I'm having the same problem with my blog.

    Right now I set all syndicated posts to be 'pending' till I approve them - I just had to trash over 100 pending posts.

    There seems to be no pattern to which posts from which feed it chooses to republish. I really have no idea what is going on. If someone comes up with a way to solve this, I would love to know!

  8. ZoliErdos
    Member
    Posted 2 years ago #

    Having the same problem, hotfix does not help.

    Forcing all FeedWordpress posts to "pending" first, deleting hundreds of redundant ones:-(

    One way to at least limit the damage is using the "FWP+: Limit posts by date" plugin and set it to 1-2 days and 1-2 post items only. This will limit how many posts are replicated, but at least in my case may risk missing valid new posts.

    I can't even downgrade to WP 3.1.2 being on a shared server:-(

  9. radgeek
    Member
    Plugin Author

    Posted 2 years ago #

    Hey y'all,

    Sorry about this, and thanks for putting up the heads-up here. I wish I had been able to push out a fix sooner, but WP 3.1.3 was released while I was on a week-long house-hunting trip. Argh.

    Anyway. The good news is that this problem should now be fixed (or worked around, depending on your perspective) in the most recent version of FeedWordPress (v. 2011.0531), now available at feedwordpress.radgeek.com.

    The rest is some technical details.

    For those who are curious, the reason that this issue arose is that the most recent release of WordPress added a URL-check filtering function for post guids. Or, rather, it applies an existing filter -- esc_url_raw() -- to a field that it hadn't previously been applied to -- the guid. That filter rejects any URI that doesn't begin with a protocol/scheme that's on a hardcoded whitelist of allowable schemes -- http, ftp, svn, gopher, and a handful of others. Unfortunately, the tag: scheme, used in tag URIs, is not on the list of allowable schemes, and WordPress provides no readily accessible way of extending the list to include it. This is unfortunate since esc_url_raw is now used to filter all incoming guids, and tag: URLs are very commonly used to produce opaque unique identifiers for use in the guid field. So, under the new rules in WP 3.1.3, posts from any source feed that used a tag: URI -- which includes all feeds produced by Blogger, all feeds produced by other Google web services, and a number of other common feed sources, as well as any feeds that don't include explicit guids (since FeedWordPress would generate a guid internally using the tag URI syntax) -- would be inserted into the database with a blank guid, rather than with the guid they were assigned by the feed. This breaks FWP's ability to recognize previously-syndicated posts, and causes the posts to be re-syndicated anew every time FWP checks the feed.

    In my view, the failure to include tag: URIs in the list of allowable schemes, and the lack of any way to extend the list to include them, is somewhere in between a flaw and an outright bug in WordPress. Be that as it may, rejected guids are a condition that FWP will have to work around in a reasonable fashion. So the new release of FWP includes a work-around to generate an allowable guid if the guid assigned to the post gets filtered out.

    So, again, to fix the issue, hopefully all you should need to do is upgrade to the most recent release of FWP.

    -C

  10. ZoliErdos
    Member
    Posted 2 years ago #

    Hi Charles,

    Thanks for responding so quickly (and I hope you've found the house...).

    But I'm afraid the fix did not work, I keep on getting the same even after upgrading...

  11. ZoliErdos
    Member
    Posted 2 years ago #

    I've just realized my testing was flawed (?) since I just forced update all feeds and saw the dupes being created again. But those were posts that already had been published with the blanked out GUID ( I assume), so the proper test is only with NEW posts, or completely deleting one of the "bad" ones and re-updating them.
    Will do more checking...

  12. ZoliErdos
    Member
    Posted 2 years ago #

    Yes, I think Charles's fix is working - have not tested a lot, but so far so good - sorry for the false alarm.

    Thanks a lot for the fast fix, Charles! :-)

  13. sygnin
    Member
    Posted 2 years ago #

    Zoli - in your case, did you have to completely remove all the entries that were being republished so that they would publish one final time as the correct version?

    Also, should I not be forcing the feeds to update?

  14. radgeek
    Member
    Plugin Author

    Posted 2 years ago #

    Zoli and I had a conversation about his case in e-mail. It turns out that the release put out today fixed the problem for some of his feeds (those which used tag: URLs), but didn't cover a distinct problem that appeared in some other feeds -- in particular, some feeds produced by ZDNet, which included leading or trailing whitespace in their GUID elements. I wrote a quick fix to cover that edge case, which is now part of the Development Version of FeedWordPress, and will be rolled into an official update sometime around tomorrow.

  15. ZoliErdos
    Member
    Posted 2 years ago #

    I've done more testing, and the new-new fix (the one coming out tomorrow) seems to be working with all my previous "problem feeds".

    sygnin: yes, you do have to completely remove the trouble entries (even from trash), so FWP can create a version with the proper GUID.

  16. sygnin
    Member
    Posted 2 years ago #

    Ok, thanks guys!

  17. niska
    Member
    Posted 2 years ago #

    Some of my feeds (that didn't work in 3.1.3) are custom made. The GUID-part looks like this:

    <guid isPermaLink="false">http://www.domain.com/myxml/xml.php?&w=1&imgs=1</guid>

    Will they work now?

    Since I have control over this feed, I could easily change the guid value. What is the preferred look of this value?

  18. kaotik
    Member
    Posted 2 years ago #

    I'm running 3.1.3 too and it's still duplicating posts when I manually hit update! I'm trying to syndicate posts from Moveable Type to WP.

  19. ZoliErdos
    Member
    Posted 2 years ago #

    As of this morning it is duplicating for me again.... :-(

  20. kaotik
    Member
    Posted 2 years ago #

    Scratch that, it's still duplicating on both manual and automatic set up.

  21. radgeek
    Member
    Plugin Author

    Posted 2 years ago #

    Kaotik,

    Sorry to hear you're still running into this problem. I have been collecting a few different edge cases to fix in a follow-up release due out later this evening. Hopefully I'll be able to catch whatever is causing the problem on your end as well. Could you let me know:

    1. Whether the dupe problem you're seeing is on *all* the feeds you're syndicating, or whether it's limited to one or more specific feeds;

    2. The URL(s) of one or more of the feeds where you're encountering the problem (to examine the XML in the feeds and attempt to test fixes on my own servers); and

    3. Whether you are using any post status for syndicated posts other than the default (i.e., having posts come in as Pending Review, Drafts, Private, or anything else other than Published immediately), and whether you are using any custom post types or other advanced features that I should know about.

    If you want to send me any of this information off-list, you can reach me through http://feedwordpress.radgeek.com/contact/

    If you could help me out with (1)-(3), it would help a lot in allowing me to make sure I cover all the possible cases when I do my testing for the follow-up fixes due out later today.

    Thanks,
    -C

  22. kaotik
    Member
    Posted 2 years ago #

    Great! I sent you the info via your contact form. Thanks.

  23. jimmytortuga
    Member
    Posted 2 years ago #

    v. 2011.0531 didn´t fix the problem of the duplicate posts. If anything it just made it worst. Before it only duplicated a few of the latest posts (since WP upgrade to 3.1.3.)Now its duplicating every post ever published outside my buddypress site. I´m erasing 300 -400 posts per day from my "pending" folder.

  24. jimmytortuga
    Member
    Posted 2 years ago #

    sorry, just saw the relaease announcement for v.2011.0602. it hadn´t appeared yet on my dashboard. will give it a try...

  25. ZoliErdos
    Member
    Posted 2 years ago #

    2011.0602 is working, I no longer have those dupes in 5 blogs.

    If you still see dupes, those are for post created in the few days since the WordPress 3.1.3 upgrades, since they already have the "bad guid".

    To get rid of all dupes you'll need delete all instances of such posts (published, pending, draft, even empty the trash)then let FWP regenerate them. Where this is not practical, you'll just have to wait out till those entries will be old enough to fall outside the range FWP picks up - but for new entries it works well.

    Btw I warmly recommend the "FWP+: Limit posts by date" plugin.

  26. niska
    Member
    Posted 2 years ago #

    If anyone has a suggestion on how to delete all posts (and postmeta) for all duplicates from the database using, please tell. A sql-query would be nice.

  27. jimmytortuga
    Member
    Posted 2 years ago #

    so I updated to 2011.0602 and that seemed to fix the problem all right. All of a sudden its starting up again, reposting the same 52 posts over and over again...
    new fix coming?
    howabout WP 3.2?

  28. jimmytortuga
    Member
    Posted 2 years ago #

    Yo! What´s the story, here? A few days back I started having duplicate posts problemas again, all of a sudden: 62 posts that I have to delete over and over again. I went to the FWP website, and it hasn´t been updated since the release of v. 2011.0602! I´ve left comments twice, but they aren´t even published, much less answered. Anybody know what´s up? Has this project been abandoned? Do I have to find an alternative?

  29. radgeek
    Member
    Plugin Author

    Posted 2 years ago #

    jimmy,

    The project has not been abandoned; the FWP website suffered a technical breakdown shortly before I left town for a cross-country move; I just haven't had time to get it back up and running yet. (It's on the docket to fix in the next few days, hopefully.) The current version of FWP is 2011.0721, the version available from the WordPress plugins repository.

    If you're encountering this problem consistently with one or more specific feeds, could you send me (either by posting here, or by e-mail to <feedback@radgeek.com>) the URL(s) of the feed or feeds where you're encountering the problem, along with the version numbers of FeedWordPress and WordPress that you're encountering it with? I should be able to run some tests; if I can replicate the problem on my end, I should be able to diagnose and solve it fairly easily. If I have any trouble replicating, I'll have some follow-up questions about your hosting environment so I can better pin down what's going on.

    Cheers,
    -C

  30. kaotik
    Member
    Posted 2 years ago #

    Hi Radgeek, I'm having the same issue again as well. You had made a fix a few months back that stopped the duplicate posts for me until you released a fix (which you gladly did), but it's started again after the recent update to the 0721 version.

    We're pulling feeds from Moveable Type. Looking forward to your reply.

    Thanks!

Topic Closed

This topic has been closed to new replies.

About this Plugin

About this Topic