Using two loops & getting right number of posts on the page

I don’t know enough about the loop to solve this. Does anyone know how to do this please:

I want to have a featured post followed by other posts and I want 3 posts on each page on a ‘page of posts’.

I have a custom loop that fetches the featured post(s) and that works using posts_per_page=1.

I have another loop that fetches the remaining posts (post_per_page=3) and that works too.

However on the first page I get 4 posts – the featured plus 3 non-featured, but on subsequent pages i get 3 posts as desired.

Is it possible to structure the loop or loops so that the two sets of posts integrate to give the correct pagination on the first page?

Any pointers on how to solve this would be most welcome. Thank you.