Using query_posts function disables page view

I am using query_posts function to show posts from only one category on my home page. By doing this, the blog pages show only the first page. So if the adress is http://www.my*site.com/page/3/ the page shows the exact same thing as in http://www.my*site.com/.

I use this function inserted in index.php right after the header:

<?php get_header(); ?>

<!-- Showing posts from category 3 alone: -->
<?php
      query_posts("cat=3");
?>

    <div id="content">

        <div id="main">

<!-- the rest of index.php -->

Is there a way to fix this? Or maybe another way to show posts from only one category on the main page and having subpages working?