categories kida wired

After installing wordpress I played with the categories.
Is it a feature that items in sub-categories are also appearing under their parent category in the blog even though I check only the box for the appropriate subcategory in the post? It looks more like a bug really or perhaps I did not find the switch to turn that off?