...I also don't want notifications to go to every author.
To be clear: a moderation notification will go only to the author of the post that has received the comment, not to every author.
If this plugin had a feature that allowed me to select specific authors that wish to opt out of all comment notification, it would be perfect.
Just like regular comment notifications, the comment moderation notifications do not have a specific opt out.
These rules can only be set on a global level by Admin and are handled by WordPress core functionality, not by this plugin. The plugin only changes the recipient of these notifications...