Will not update – can not remove earlier version

I have been experiencing problems with the forms not submitting on one site and when I noticed an update was available I attempted to update it. It said that the update failed – older version could not be removed.

Next I deactivated the plugin and attempted to delete it so I could download a fresh version. It asked for permission to delete all the files and I clicked yes. It appeared to go through the delete process but it did not delete.

I have updated other plugins today on that site without issue.

I would live to know what is going on with this.

https://wordpress.org/plugins/contact-form-7/