This is been asked for, and the capability is (sort of) in the plugin already, but it's a little more complicated than that. The standard library page has three loops (three queries). Paging would affect all of them individually.
The only way paging would be effective would be if your library page was not divided by status as is the default, but was rather an alphabetical (single query) listing of all books you've added. While I agree that this could be a desirable thing, it would be too big a change to add to the plugin right now, since it would break a lot of existing installations.
I'm considering it for the nebulous 6.0 version of NRR, but I have no clear picture of when that's coming (job + grad school + wedding plans).