changing default permissions for WP-generated files?

Files and directories generated by WordPress are owned by the Web server user. Normally this is fine, but if I want to manipulate (delete, traverse, manually upload or manage) these items directly over FTP or SSH, it becomes a real problem as I have no way of doing so. Is there a way to change the default permissions WordPress uses so I can give my regular user account access?