Non-organized uploads to month/year based uploads

Currently I have most of my uploads in the base wp-content/uploads folder however, as I upload more things I want to sort them into the month and year folders. I ticked the option in media settings, and new uploads were added to year/month folders, but nothing was done to the old uploads. Any way to sort the old files like the new ones?