Changing “older entries” at bottom of blog page

Right now at the bottom of my page I have the “Older entries” as the way to navigate from blog entry page to blog entry page. But I would like to change this to something like “1 2 3 4 5 next last” at the bottom. Is there a widget or some such thing that would allow me to do this?

Any help would be great.