Reverse proxy with links reverse-proxied, too?

Hello there, didn’t know where to post this, but maybe I’ll have some luck here.

I have a problem with a reverse proxy my wordpress site. I need it to be have the reverse proxy applied to all the links without having it applied to the content, images, css, etc.

I just found a plugin that changes all of the links in the site to relative links (It’s called “Absolute Relative Links”). This is great and is ALMOST what I need… The problem is that all of the links are changed to relative, including the content, images, css, etc., causing the site to not display properly since it’s being pointed to the wrong places for its images and css.

Does anyone know of a way that I can make only the links on the site relative (i.e. pointing to the reverse proxy url) and not the images and other data that makes the site display?