It would appear it was the WP-Supercache plugin causing the problem… hmm… Is it okay to leave that plugin off? I never installed it in the first place, I think my host automatically installed it when I used their installer to install WordPress.
Any help at all would be so very appreciated.