Sexybookmarks. That was the culprit on mine. I did do the change in http.php first, then I remembered somewhere while watching the site load on Firefox or something) that Sexybookmarks caused a slight delay while resolving. That was a few days ago and I took a “mental” note.
Then this stupid thing happened and I could not access admin AT ALL! This thread was a lifesaver and convinced me to be a WordPress Forum regular… 😉
I left http.php change intact. No harm in leaving it, 5 secs is ridiculously short I think.