Mod_ReWrite Installed but still have problems

I just got my install up (that was easy!) and everythign seems fine except for the fact that I cannot get permalink or other URL’s to work without adding index.php to the config. Thus I get urls like this:

http://www.alttext.org/wordpress/index.php/?p=6

What am I doing wrong?

My server has mod_rewrite instaled:

http://www.alttext.org/info.php

Thanks for the help for a new user.