With WordPress release 3.3, you completely revamped the media upload/insert feature.
Now that we have a nice all-in-one uploader and media insert button, I don’t think it’s still necessary to have it staying alone above the post editor. Plus, if I follow your “just write” concept, I think it is more disturbing than useful.
1 -- The removal of this upload/media button in order to place it in the toolbar. It’s (just) a tool we can use to embellish the text but it is not the main component of the post/page editor. It doesn't help you to write.
2 -- If we move this tool, we could also move the Visual/HTML toggle, which is another tool, the same way so we can reduce the white space between the title field and the editor.
3 -- Let's fade away the permalink modifier when it's not "hover" or "focus".
I wrote a note about that and posted some pictures to mockup the concept on my blog. See this post.
Thanks for reading this!
Side note: if one day you consider moving the media button, please don't let the visual/html toggle alone because it would be the same again and again.