I’ve ended up using a plugin called “Conditional menus” and it did just the trick I wanted. Thank you for replying, though!
This is the exact issue I’m facing as well. I’d also love to know if there is anything we could do about it.
My other suggestion is for you to disable the preloader.gif (I don’t know how to do it yet, though.), since running a test on http://tools.pingdom.com/ showed me how much time the preloader.gif takes up from the loading time.