File Management For Clients/Project Manager

I’ve been searching for a plugin that will allow clients and I to upload and share files. I have a client page that shows invoices created for that user and I want a list of project files to be shown as well. I feel like I should be able to do this with wordpress’s built in media manager but how can I make it so files can be added to a project and then listed on the clients page? I want it so clients can only see the files added to their projects.

Any help would be appreciated, just point me in the right direction.