Limit specific users to post in specific categories?

I am looking for suggestions on how to let specific users write new posts only in specific categories.

For instance, if I have Joe logged in, I want Joe to only be able to post in Joe’s Town category. Likewise, I might want Pete to only be able to post to Pete’s Town, and so on.

I am aware of the Limit Categories plugin – however, it seems as though that will only create limitations around user roles (editor, author, contributor, etc). I need specific user settings based on their login, not their role.

Is this possible? Your advice is appreciated.

dan