I just installed (via yum) wordpress on my own Scientific Linux server (jick.net) with no trouble. It goes into /usr/share/wordpress and the wp-config.php file is in /etc/wordpress/ -- I set DB_HOST to "localhost" and it works great when I access it from the server itself (http://localhost/wordpress).
But when I try to reach it from the Web (http://jick.net/wordpress) I get 403 Forbidden. Nothing seems to help. There is no .htaccess file in either directory. I tried making a symlink to /usr/share/wordpress from /var/www/html/ but that had no effect, so I removed it.
The MySQL database looks fine. I rummaged around and found that the first option in wp_options (namely "siteurl") is set to "http://localhost/wordpress" which sounds a bit restrictive, so I tried changing same to "http://jick.net/wordpress" but then nothing worked at all, so I wiped it out and reinstalled. Same result. I suspect there is some point at which I need to say "jick.net" instead of "localhost" but I'm tired of guessing and backtracking.
How is this supposed to work? Most of the docs seem to assume I am running on someone else's server.