Disable adding categories

I’m presented with a unique situation. The project I’m working on requires that I disable the ability for blogs other then blog ID 1 to create categories. This means I need to disable the add categories on the category page as well as on the post/page pages.

So far, I haven’t been able to find any actions that may help; my only idea so far is to remove the ‘manage_categories’ capability when blogID != 1. Anything else I can do?