webhost added self-promoting link

I had my host do the quick install of wordpress on my website, and it seems to be working great except for one thing. They’ve included some self-promotion (the host) which appears at the bottom of the blog. There is no other advertising on my site, so I know it’s something they installed along with wordpress. I figure I’m paying them and therefore I shouldn’t have to see their link on my site. Any idea how I can get rid of the file that puts their link there?