WordPress without tinymce Visual Editor

I never use the visual editor in WordPress, yet the /wp-includes/js/tinymce/ folder, for some reason, always causes problems when I’m uploading it when upgrading.

I’m just about to try just leaving this folder out of my installation. I guess I’ll find out soon enough if this might cause any issues – but anyone know off-hand if there might be problems even if I never switch to the visual editor?

Gyrus