I downloaded the wordpress zip and then re-uploaded the deprecated.php file. All seems to be fixed now. Thanks for your response cubecolour!
It was some maintenance splash page. The first thing I deleted was the deprecated.php (probably a big mistake). Then I deleted the plug in, and the plug ins folder entirely.
