P.S.3: From what I tested when I input the manual location/city it works every time. When I change it to automatic IP/Geo Location detection it stops from time to time. That is why I am certain that the ip geo location detection is the problem. Oh and also the problem persists with or without Google Maps Api.
Sorry for writing so many posts, just trying to be as specific as possible.
P.S.2: My OpenWeatherMap API is the paid one with 600 requests/minute available, so that could not be the problem.
P.S No iptables rules apply, no filters in or out apply on my server. jWhois is installed and works properly (if that’s the tool used for getting the IP info)