remove_filter(‘authenticate’, ‘wp_authenticate_username_password’);

I am writing an authentication plugin that attaches a filter to ‘authenticate’. I want to prevent lower priority filters from authorizing login if my plugin fails. (More specifically, I want to prevent the default WP behavior)

I tried to use this:
remove_filter(‘authenticate’, ‘wp_authenticate_username_password’);

and

remove_filter(‘authenticate’, ‘wp_authenticate_username_password’, 20, 3);

but neither seem to do the trick.

Am I doing this right?