Support » Plugin: Delete Duplicate Posts » It doesn’t work with websites with hundreds of thousands posts.

  • Resolved Fabio Perri

    (@fabioperri)


    Hi dear @cleverplugins , @lkoudal , @freemius ,

    Unfortunately, your plugin Delete Duplicate Posts does not work on websites with with hundreds of thousands posts, in practice it never finds duplicates and I can guarantee you that on several of my websites with with hundreds of thousands posts where i have many duplicates, unfortunately it does not work and does not find any duplicates.

    Can you help me solve this problem ?

    PS: Obviously the servers i use are dedicated and very, very powerful servers.

    Thanks in advance for the support.

    • This topic was modified 8 months, 2 weeks ago by Fabio Perri.
Viewing 14 replies - 1 through 14 (of 14 total)
  • Plugin Author Lars Koudal

    (@lkoudal)

    Hello

    Please take a look at the log in the plugin and tell me what it says – any error there?

    Do you have an error in the debug.log file?

    Have you tried testing fewer post types, if you check all kinds of posts at the same time, your server could be timing out.

    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    I have installed the latest and updated Delete Duplicate Posts v4.5

    On the setting of Delete Duplicate Posts i have this setting:

    – Which post types?: Post (i have selected only this)
    – Post status: publish (Published)
    – Comparison Method: Compare by title (default)
    – Delete which posts?: Keep oldest
    – Enable automatic deletion?: Off
    – How often?: [W3TC] CDN queue process (disabled)
    – Send status mail?: Off
    – Email recipient: None (blank)

    When I click at the bottom on the “Save Settings” button at the top the animation starts with a gray circle and a white dot that turns inside the circle, so I assume it is looking for duplicates but after just under two minutes it disappears and at the bottom nothing appears in the “The Log” box.

    When I click at the bottom on the “Save Settings” button at the top the animation starts with a gray circle and a white dot that turns inside the circle, so I assume it is looking for duplicates but after just under two minutes it disappears and at the bottom nothing appears in the “The Log” box and furthermore I specify that I do not use custom post types to embed content.

    This is the content of debug.log file :

    PHP Deprecated: get_settings is deprecated since version 2.1.0! Use get_option() instead. in /my-website.com/httpdocs/wp-includes/functions.php on line 4859

    Please help me to solve this problem.

    Thanks in advance for the support.

    Plugin Author Lars Koudal

    (@lkoudal)

    Hello @fabioperri

    Aha, ok – sounds like there is a lot of content on that site to process?

    I will try to test on a site with thousands of duplicates, perhaps I have just not hit the limit. Perhaps I have to introduce a limitation of how many duplicates to find per check.

    Regarding the “get_settings” – that is not in this plugin, must be another plugin installed that uses that function.

    Plugin Author Lars Koudal

    (@lkoudal)

    Hello @fabioperri

    I am just now pushing up a new release, version 4.6 – this version introduces a beta feature that lets you limit the amount of duplicates the plugin finds.

    This can help with the timeout problem that can happen on big websites. The database query to find duplicates can take a little time to run.

    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    First of all thank you so much for the professional and very fast support, thank you.

    I have already installed version 4.6 and I am testing it, as soon as I have news I will tell you here.

    Thanks in advance for the support.

    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    If I deactivate and then reactivate your plugin v4.6 in the plugin page at the top, I get this red warning:

    The plugin generated 15 characters of unexpected output during activation. If you notice “headers already sent” messages, problems with syndication feeds or other issues, try deactivating or removing this plugin.

    Please help me to solve this problem, thank you !

    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    Also your plugin v4.6 completely breaks the css and graphics of the whole website and even on FireFox (latest version) if you go to the website a full page full of these symbols is loaded:

    ���]o#Dz �|�+��q��f���”)�論�>�uZ�ϱ=B��$�U�*ׇ$v[�]w��,�;��w؇}X�ܗ}��G���’lDf}��S*I���9�]��̈�������|��������>����<Ŀ?s�;ٱ#���>�ix�-���V��M�֌���^C��lj�E�5xFs��٤��3ە�ԞL�-�?�x���:�{�Y@�h��%M�Nھ�'���ț��|y�u����� �g�yq�Miۏ���a�aK-�zJ$� G��G��3��FS�4�i�=z,��[��΃3ۊ�;=�GTf?���ڑ p�q��R�Ҍ�۳xV|�4��^)$���΃S��A?������t %�j�^��4� ]b;}bY�;��^y�����:_\�Nm�z�E�^�~C|���$���ֽǏw���$nt1���۔��Z����q�]4��N��m���>�@���a<���{�!u�S;�#j�7>�

    Once you deactivate your plugin, everything works fine.

    Please help me to solve this problem, thank you !

    Plugin Author Lars Koudal

    (@lkoudal)

    Hello @fabioperri

    Please check for 4.6.1 that should be available shortly – this should fix the problem with the unexpected output. I have not been able to see any garbled output anywhere, frontend or admin, but please check the updated version to see if that problem is resolved also.

    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    Now I install it right away and update you as soon as possible.

    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    I just finished testing it.

    I tested it on these 4 browsers:

    FireFox (latest version) – Google Chrome (latest version) – Opera (latest version) – Microsft Edge (latest version)

    Everything works perfectly and also activating and deactivating the plugin both by clearing all the cache and not by clearing all the cache and by restarting Nginx and PHP-FPM and not restarting Nginx and PHP-FPM.

    Thanks to your exceptional and super fast addition of this fantastic beta feature now even websites with hundreds of thousands of posts can finally find and delete all duplicates on their website in complete safety and with great speed and efficiency. better use of server resources that will never be wasted, providing users with a better user experience and also improving their SEO.

    I kindly ask you to be able to include this fantastic beta feature in the free version of your exceptional plugin, please kindly take this request into consideration.

    I am confident and awaiting your reply 🙂

    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    In the bottom box “The Log” i have this:

    2021-01-15 06:03:09 50 duplicates found in 114.69 sec.

    But the problem is that at the top it doesn’t show any duplicate files to be deleted and it doesn’t show any Delete Duplicate button available (the color of the Delete Duplicate button is grey and it’s not clickable) !

    Can you help me solve this problem.

    Thanks in advance for the support.

    • This reply was modified 8 months, 2 weeks ago by Fabio Perri.
    • This reply was modified 8 months, 2 weeks ago by Fabio Perri.
    Plugin Author Lars Koudal

    (@lkoudal)

    Hello @fabioperri

    Wow, 114 seconds – I will try to improve the query made for detecting duplicates, but with a site of your size I think no matter what I do it will be hard for the plugin.

    Did you take a look at the PHP timeout setting? try to increase if the site is slow looking up duplicates.

    You can set this via PHP.ini or via wp-config.php by pasting this line:
    set_time_limit(300);

    I understand that the plugin returns a count of duplicates, could I ask you to see if there is a JavaScript error that prevents the list of duplicates to be shown?

    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    I have this JavaScript error:

    Failed to load resource: the server responded with a status of 524 () /wp-admin/admin-ajax.php?_fs_blog_admin=true:1

    function(e){var t;if(e)if(h)T.always(e[T.status]);else for(t in e)w[t]=[w[t],e[t]];return this} error delete-duplicate-posts.js?ver=4.6.1:211

    Also I took your advice and set up PHP.ini with set_time_limit(300); now we will see how it goes with this setting and thank you for the advice.

    Thank you in advance for your precious help and for your kindness, thank you.

    • This reply was modified 8 months, 2 weeks ago by Fabio Perri.
    • This reply was modified 8 months, 2 weeks ago by Fabio Perri.
    Thread Starter Fabio Perri

    (@fabioperri)

    Hi dear @lkoudal ,

    Any news about my previous post ?

    Thank you in advance for your precious help and for your kindness, thank you.

Viewing 14 replies - 1 through 14 (of 14 total)
  • The topic ‘It doesn’t work with websites with hundreds of thousands posts.’ is closed to new replies.