moving wordpress

I really thought the hard part would be moving the database, but I figured that out fairly easy, even though cPanel gave me some problems. My problems are with moving the files and not have the plugins break causing some major problems. I am using ftp and I don’t know if that is the best way, but it is the only way I know. The first time I didn’t deactivate the plugins and WP3 Total Cache would not deactivate or uninstall. I tried just deleting it and that caused everything to break. I am now in the process of moving the files again, this time with the plugins deactivated first. I hope this works this time. If any one sees something terribly wrong with what I am doing, please let me know. Any help would be appreciated.