Thanks for the feedback, I will definitely try to take that route.
I sort of figured this, because if it was a plugin related issue my site would be slow all the time not up and down week to week like it is now.
The error goes in and out so how would I know which specific plugin is causing the problem? For instance, last week there was not one problem at all. Smooth as could be. This week, its been slow and 500 internal error has been coming up constantly.