Ok I seemed to have fixed it so if anyone has a similar issue you can try and add the following code in your custom css:
@media screen and (max-width: 960px)
{
#ml-background-video-wrapper { display : none; }
}
Make sure to change #ml-background-video-wrapper to whatever your div ID is. Not sure why it was working before without specifying the screen size. :-/