Media Library > "Delete Permantently" Only deletes originals, not variations

I have multiple image sizes set through my functions.php that generate multiple image files for each image uploaded. I would expect when an image is “Deleted Permanently” from the Media Library, that *all* size variations of that image are deleted along with it, but this does not seem to be the case.

Is there are way to set “delete permanently” to delete the original image along with all of its variations?