Prevent Child Category from Inhereting

Hi, I’m trying to add custom templates to the categories and sub categories, however when I add a template to a parent category, the child category still uses it, even though I have not selected the template to be used in the child category.

Any help would be greatly appreciated.