OK, problem solved!
Used Chrome inspector and realized there is some logo.png trying to load from a weird IP address, went into theme settings and removed it (was never used anyway)
Tada!
Thanks!
Thanks for your help @t-p
Yes, with Health Check in Default Theme mode it loads quickly.
Now how do I understand what exactly in my Theme causes the long load?
