This has been a problem since 2.0.3 and probably before then. But that's when I discovered it.
If you have WordPress in your root directory and you're using permalinks, then the cgi-bin is completely killed, won't work (403 Forbidden). As soon as the WordPress-generated code inside .htaccess is removed, the cgi-bin will function correctly.
Please correct this in WP 2.2!