Renaming files leaves orphan thumbnails

I have Media Library Folders Pro.

When I rename a file, the old file no longer exists, but the thumbnails for that file remain, while new thumbnails for the new filename get created as well. This causes cluttering.

I could use another plugin to clean up these orphan thumbnails, but I’d prefer it that this clutter doesn’t get created in the first place. Is that possible?