what about this exploit ?

You should update to 2.06, yes. Other possible problems exist in prior versions.

This exploit doesn’t affect WordPress 2.06 particularly, except in some unusual circumstances. Many people have tried it without success. Basically, it exploits a PHP-specific bug to bypass WordPress’s security checks. Your host should update to the latest version of PHP to avoid issues.