Using offset with WP_Query and menu_order

I’ve got a custom template that’s pulling from a specific category and the client is very particular about the post order, so the query uses ‘orderby’ => ‘menu_order’. However, on the secondary page the posts need to be offset, which I know doesn’t work with menu_order. Right now I’m hiding the posts with CSS and nth-child and it’s so hacky I feel terrible… Has anybody run into this issue before or have a clever work around? Thanks in advance!