“The Loop” is a term that refers to the main process of WordPress. You use The Loop in your template files to show posts to visitors. You could make templates without The Loop, but you’d only be able to display data from one post.
Here are some examples and extended information found in the WordPress Codex: