Only enforce Scroll to close for ACCEPT button

Is it possible to only include the ACCEPT button in the scroll to close requirement? Currently selecting scroll to close makes the pop up a potential dead end. Ideally I’d like users to be able to close the pop up by clicking on the X, overlay, or decline buttons immediately, however, only by scrolling to the end can they choose the ACCEPT button.