[Plugin: easyCommentsPaginate] does not display proper amount of comments

I have my comments in the display settings to display 5, I have set this to display 5 as well but for some reason it only shows 3 per page, but it acting as if 5 were displayed.

Any ideas?

http://wordpress.org/extend/plugins/easycommentspaginate/