PHP template tags, please explain

Hello,
I was reading through codex, but there is only information for users and i need a little more details.
So the question is how the template PHP tags work? For e.g. the “bloginfo(‘name’)” tag. I do not understand where is the list of all these WP template tags? How the PHP server knows these tags to execute them?

Thanks a lot.