The problem was caused by installing it via network install. When I installed in for the particular blog, the problem was resolved.
Dear Bojan,
Thank you for the answer. Turns out, you were right. There was an old plug-in installed on my wordpress network. I deactivated the plug-in and the button vanished! Problem solved.
With thanks,
Bret
