Thanks ESMI!
I found another way to do it by following this post:
http://www.snilesh.com/resources/wordpress/wordpress-tips-and-tricks/different-single-post-template-per-category-wordpress/
I think your solution might work better, but I got it working by following the link I posted above
