Want to install WordPress on PC w/o making it a server

I have never used WordPress. I have hosting space at GoDaddy, and it auto-installs WordPress onto your hosting space and does (it looks like) a lot of the dirty work for you.

However, since I’m new to WordPress, I would like to install it on my PC and create there – and after I’m satisfied with the finished product, upload it using FTP.

The help files I have seen make the PC the server – and I do NOT want to do this. Is there a way to do this (simply – I’m NOT a techie)?