Remove “+ Add New Taxonomy”

That should only show for users with that capability. So you can use something like Role Editor plugin or Members plugin to adjust the capabilities, so that some users don’t see it.