How can I change this?

Hi folks!
I am a total noob with this so please be patient. I have done multiple searches for this topic, but what I find doesen’t make sense to me, especially since I have absolutely no knowlege of php. Here’s my problem:

I have a couple of areas on my blog’s first page that I want to edit. I looked at all the files that I thought would correspond to what would be the first page of the blog, but it all was gibberish to me. I then decided to copy the source code for the page, and through doing that, I found exactly the areas that I wanted to edit. Here is one:

<title>The Roving Activist’s Blog </title>

I don’t know how it got like that, but I want to change it to the actual name of the blog. Here’s the second:

<li><a href="http://www.civilrights.org/" rel="colleague" title="Civil Rights Organization">Leadership Conference on Civil Rights</a></li>
<li><a href="http://"></a></li>
<li><a href="http://www.blogion.com" title="Blog Directory">Blogion</a></li>
The second link is a blank link, and I want to get rid of it.

As you can see, this is done in http, but I was told that it was generated by php. I would like to know exactly what file is this. I suspect that it is the index.php file in my wp content file, but when I open the file, it is gibberish. If I opened the file in notepad, will it look different? Will I be able to edit it?

Thanks in advance for your help.

PS– I noticed that after I posted, and saw how my post look, I notice that my site’s name looks fine. Why does it look like gibberish in the title code?

Thanks!