Just to let you know guys that I have searched the forum thoroughly to find a solution before making this post.
What I want to achieve is echo/display on my category page ( on each of my category pages), a simple numerical value for the number of posts within that category. Something like the example given below :
Posts in this category : 86
I hope I was clear enough. Anybody up for suggesting me a code to achieve this please.