I can confirm this happening to me as well. In the odd occasion I can access the Download Monitor to add new downloads it will loose connection, with WordPress specifically telling me that at the top of the page. But in the past few days simply clicking Downloads from within the WPAdmin makes it lag/hang.