Forum Replies Created

Viewing 15 replies - 1 through 15 (of 24 total)
  • Thread Starter kvrmedia

    (@kvrmedia)

    That was all set up. Thats not the point. I was asking to recover missing data. On current site, the inbox is populated how its supposed to. I was referring to the lost ones.

    Thread Starter kvrmedia

    (@kvrmedia)

    Hi Takayuki, I opened the ticket in Flamingo Area to be better allocated. But since you flagget it duplicate there, we might as well continue here.
    Therefore I changed status to not resolved again.
    In the meantime I have found out that many of my wp-database tables where missing primary keys and had lots of duplicate entries with id=0. I repaired all that by now. But my above question remains.

    Thread Starter kvrmedia

    (@kvrmedia)

    UPDATE:
    Just to sum up, it all came down to a corrupt database, which had grown insane over the last 10 years and somehow (really no clue how that would have happened!!) some tables had lost their primary keys, unique keys, indexes and auto_increment assigned. This lead to many entries in various tables with “0” ids where should have been primary key and auto_incremented.
    No wonder I ran into all of these problems.
    I needed to repair all tables affected manually and now the system is running smooth again. Last media scan worked like a charm, too.

    Lesson learned: keep database surveyed (primary keys/ auto_increment) and clean. Thats why I just downloaded your database cleaner plugin as well and already got rid of tons of unsused, orphaneged data (website runs since 10 years…). And, yes! Still up and running! 🙂

    Thanks Jordy for some awesome tools. And thank you for your patience.
    Cheers!

    Thread Starter kvrmedia

    (@kvrmedia)

    After 2 days of deep investigating I finally found out that parts of my db were corrupted. Somehow some tables didnt have primary keys and auto_increment assigned, which lead to an armada of errors throughout all site operations becaus of many “0” entries (duplicates). No clue how that could have happened. After some hrs of “open heart operation” I reassigned the keys and properties missing and as of today the system works ok (as it seems).
    Ran a media library scan and no issues were detected.
    I suppose cleaning also now works fine.

    Lesson learned: keep database surveyed and clean.
    Thats why I just downloaded your database cleaner as well and already got rid of lots of unsused, orphaneged data (website runs since 10 years…).

    Thanks Jordy for some awesome tools. And thank you for your patience.
    Cheers!

    Thread Starter kvrmedia

    (@kvrmedia)

    Hey Takayuki, we use 3 different forms (CF7): contact, availability request and booking request/reservation.
    As I said, right now its again working fine and “subject” as well as “from” are displayed in the flamingo inbox just how I implemented it using the extra settings in CF7. Its just this gap from yesterday until 8-2-2022 where these dont show up (just , allthough aparently in the wp-database. I (unfortunately) have been doing some db-cleaning routines (wp-optimize and wpml) due to some severe problems (site crashed). Maybe that already caused some mess, but I wanted to ask anyways if you have an idea where to poke the system to recover/visualize the data missing?

    Thread Starter kvrmedia

    (@kvrmedia)

    In the end I used the option “skip all” given in error prompt. It wouldnt delete all files but a few. Each run. I let the process run through about 20 22 times until the amount of files in the trash folder wasnt reduced any more on the last 3 runs – shrunk down from 8000 to 180.

    After that I used the filescan to have identified roughly 1.2Gig (24.000 files) in my uploads folder that werent referenced in the media library nor content.
    Scan and deletion (only 2 runs) worked more or less flawless. Trash still showed 5000 files, but they werent physically in the wpmc-trash folder (which only/still contained 15 images, though i used the plugins “empty trash”. Thats still pretty impressive. Thank you!!

    All in all I suppose our website being live for 10 years more or less maintained well, ended up with a real mess – thousands of unused images and due to many changes and plugin de/installations also a faulty database. Reasons for Irregulations using the plugin are probably not to look for in the plugin itself, but in the own existing website install. Would have appreciated a little more support in explaining errors or pointing out what to check/repair. Anyways, great tool. Thanks a lot.

    Thread Starter kvrmedia

    (@kvrmedia)

    To sum it up here are some keypoints for anyone with same problems or wanting to clean up the medialibrary using the plugin media cleaner (thanks to Jordy for pointing me into the right direction!):

    1. Backup your database (e.g. with phpmyadmin or some plugin) and uploads folder (e.g. with ftp client filezilla)

    2. Aparrently for DIVI users pro version is mandatory.

    3. Disable all performance/caching and image-related plugins before starting to scan and work withi the media cleaner (or media sync)!
    In my case it was wprocket, autoptimize, apcu-manager, shortpixel and WPML-Media that had to be deactivated to avoid issues working on the cleanup.

    4. Have a consistent database – If there is a mismatch between files in uploads folder and listings in media library – like I had many files that did not show up in the media library and many entries in the media library without files existing in the uploads-folder – media cleaner might produce errors on deleting files so I’d recommend the plugin media sync to run first in order to synchronize db and uploads folder.

    5. When synced, run media cleaners media library scan and enjoy deleting files that are not used in content, as well as media library entries with files missing in the uploads-folder.

    6. dont forget to re-activate all plugins that have been deactivated for the job to be done – or follow jordys suggestions on the performance ones 😉

    7. Keep the files in the media cleaner trash folder for some days and thoroughly check your website for missing images. Once you feel on the safe side, empty trash to reduce uploads-folder size.

    Hope that helps. Cheers!

    Thread Starter kvrmedia

    (@kvrmedia)

    Yeehaw! Finally, after having moved about 8000 files to the trash folder of media cleaner, media library loaded again and images are showing up. So far the website seems to load all images properly as well.

    Took a bit of a detour and spent of time, but in the end plugin worked fine!
    So happy now!!

    Thread Starter kvrmedia

    (@kvrmedia)

    Ok because this still took lots of time, towards the end, I got curious and tried also deleting 500 and 1000 entries at a time. Worked as well and sped up the process significantly. Could have probably also hit the “delete all” button, since the plugin itself already reduces the serverload by firing only small batches with time delays during deletion process. At this point the plugin seems to be working like a charm. 🙂

    Thread Starter kvrmedia

    (@kvrmedia)

    Next, the media gallery scan of media cleaner plugin reveales some 1000 files “not used in content” and some more thousands of files with “no attached file” (which I found quite strange). Anyways, so I started to delete all of them starting with small batches (10 at a time) and worked my way up to 250 at a time (did not wanna challenge my luck any further ;-).

    Thread Starter kvrmedia

    (@kvrmedia)

    So with the media sync plugin i was able to add a couple of thousand images to the media library. And the database seemed to be in sync again. Downer: the media library wouldnt load the images anymore and showed some critical error.
    I kept faith and let the Media Cleaner again run its scan anyways, hoping to be able to delete the unused files / unatached media gallery entries and thereby clean the media gallery (and db) to a point that the media gallery would load normally again.

    Thread Starter kvrmedia

    (@kvrmedia)

    The File scan revealed more 2000 images that are lurking around in my uploads folder, but do not show up in the media library. File permissions seem ok, so I guess my db is kinda out of sync. I will try to get all files into the media library by using the media sync plugin first. Then I will run again media cleaner to hopefully finally get /uploads and library cleand up.

    Thread Starter kvrmedia

    (@kvrmedia)

    Maybe trying the file system scan is the way to go then?

    Thread Starter kvrmedia

    (@kvrmedia)

    Wait, maybe they are not found, because they actually dont exist anymore, because I actually did delete some files in one of the first runs (non-pro-version).
    Just why do they show up in the scan then – because of activated perfomance plugins back then?

    Thread Starter kvrmedia

    (@kvrmedia)

    This time (with wprocket, autoptimize and apcu manager deactivated) I chose to only delete the first 50 items. This time there was no prompt of server error, but when process was finished the scanned list was again empty and “trash” did not show any items (neither did “references” nor “issues”).
    Last instance of error log:
    [Sat Jun 24 17:36:05 2023] [error] [client 93.108.60.19:0] AH01071: Got error ‘PHP message: Media Cleaner: Could not find attached file for Media ID 58068PHP message: Media Cleaner: Could not find attached file for Media ID 58069PHP message: Media Cleaner: Could not find attached file for Media ID 58070PHP message: Media Cleaner: Could not find attached file for Media ID 58071PHP message: Media Cleaner: Could not find attached file for Media ID 58072PHP message: Media Cleaner: Could not find attached file for Media ID 58073PHP message: Media Cleaner: Could not find attached file for Media ID 58074PHP message: Media Cleaner: Could not find attached file for Media ID 58075PHP message: Media Cleaner: Could not find attached file for Media ID 58076PHP message: Media Cleaner: Could not find attached file for Media ID 58077PHP message: Media Cleaner: Could not find attached file for Media ID 58078PHP message: Media Cleaner: Could not find attached file for Media ID 58080PHP message: Media Cleaner: Could not find attached file for Media ID 58082PHP message: Media Cleaner: Could not find attached file for Media ID 58084PHP message: Media Cleaner: Could not find attached file for Media ID 58086PHP message: Media Cleaner: Could not find attached file for Media ID 58088PHP message: Media Cleaner: Could not find attached file for Media ID 58090PHP message: Media Cleaner: Could not find attached file for Media ID 58092PHP message: Media Cleaner: Could not find attached file for Media ID 58248PHP message: Media Cleaner: Could not find attached file for Media ID 58249PHP message: Media Cleaner: Could not find attached file for Media ID 59611PHP message: Media Cleaner: Could not find attached file for Media ID 59612PHP message: Media Cleaner: Could not find attached file for Media ID 59665PHP message: Media Cleaner: Could not find attached file for Media ID 59666PHP message: Media Cleaner: Could not find attached file for Media ID 59693PHP message: Media Cleaner: Could not find attached file for Media ID 59694PHP message: Media Cleaner: Could not find attached file for Media ID 59813PHP message: Media Cleaner: Could not find attached file for Media ID 59814PHP message: Media Cleaner: Could not find attached file for Media ID 59815PHP message: Media Cleaner: Could not find attached file for Media ID 59816’, referer https://www.karmasurfretr—aso

    Any advice for the 4th run?
    🙂

Viewing 15 replies - 1 through 15 (of 24 total)