Fresh install of 3.8.1 > Login redirect loop

We were hosting our sites with a shared hosting and decided it was time to move on to a VPS. Our main site uses drupal and our blog runs on wordpress. Everything is running fine, but when I try to login I get redirected back to login page.

So I wanted to try to rule out the plugins and any other things that can cause this issue. I created a new account in our VPS and installed WordPress 3.8.1. I had to use the following fix to get around the “Cookie Error when Logging In”:
http://wordpress.org/support/topic/cookie-error-when-logging-in?replies=117#post-4831316

I tried login in and I still get redirected to the login page. I renamed the two plugins that comes with a fresh install of wordpress and still get redirected. I also created an .htaccess file with the Basic WP code:
http://codex.wordpress.org/htaccess

I’m thinking is there something like varnish that can be causing this? Is there a way I can disable varnish for wordpress? Is there something else that can be causing this issue?

Here is the URL to the fresh install of WordPress:
http://blog.thinkparallax.com