Yes, I think the issue is with plugins itself. I renamed the plugins folder and it works fine. So, now let me check which plugin creating the trouble.
Here is the URL
http://blog.rivalhost.com/
But once if I open it from the Admin panel, after that the browser will show the website without loosing the styles. So I should try another browser to check it.
Thanks
