Strange code above the header

Recently I migrate from a shared hosting plan to a VPS.
But after the migration (done by the hosting company Midphase), there is a strange code appear on the top of my blog. It is above the header.

The code is: “); ?>”

It even appears in the dash board, at these places:
1. below “Latest Activity”
2. above “WordPress Development Blog”
3. above “other wordpress news”

Does anyone know what might have caused this?

Thanks in advanced.