Get previous post for one specific category

I am trying to create very particular Next/Previous Links.

I have several categories (Fruit, Animals, Cars)

Under Fruit there are several subcategories (Banana, Apple, Orange, Grape).

On a post in the Banana category, I want to create a link to the Previous/ Next post on Bananas.

The only way I can find to do this is to exclude_categories ( Apple, Orange, Grape). But then that requires that I must update my function every time I add a new Fruit category. Is there any way to include_only rather than to exclude. Basically I’d like to find something that looks like this: get_next_post( category => Banana)?

Am I missing something? Is this already possible?

Thanks for teh help.