query_posts() and pagination on single.php

I’m building a theme that will show a list of recent posts at the bottom of single posts. This list of posts should also be able to show previous and next posts (pagination). I used query_posts to stop loading the single post and get to list of posts instead. For the loading of the single post I use the get_post method.

This is working fine except for the fact that pagination of this list doesn’t work, the same loop does work in the category page so i figure that wordpress doesn’t allow for pagination in single.php?

Is there anyway to get this working? Or am I using the wrong method(s) to get this done?

Thanks in advance!