Hey there, just wanted to follow up and say I resolved this issue. turns out my hoster Auto-enables Caching on the site, which was a part of the issue.
For anyone using this as a reference for the future, please check if your hoster auto enables cache. For example, my previous one I tried with was EasyWP and they will not let you disable their caching plugins. So I decided to go with a different hoster.
