Remove comments link only when closed.

My question revolves around removing the comments link only when I have them closed. On my site, I leave half of my posts open and half closed to comments. What I’m trying to figure out is how to remove the comments link whenever I have the comments closed however leave the comments link whenever they are open, that way my readers will automatically know if they can comment or not.

Is this able to be done or is there no way to do it? As it is now, all of my posts have the comments link and the only way to tell if they are open or closed is to click the link and then see if the comments form is there or if it says “Comments are closed.” Thanks in advance!