Shipping Zones and Flat Rate Shipping

I need some help with shipping. Im using the woocommerce shipping zones as I use priority shipping and the price varies depending on where its going. I also however have some non priority stuff that would ship flat rate.

But if someone adds both products to the cart both shipping methods show up and I only want the priority (more expensive option) to show if both are added to the cart.

Is there a way this can be achieved. I cant use shipping classes for this, is there any other way of restricting a shipping method from showing if there is a more expensive option required.

Thannks

https://wordpress.org/plugins/woocommerce/