Thanks for the hint.
I also installed the plugin NextGEN Gallery ( http://www.nextgen-gallery.com/ ), version 2.0.61. Disabling that solves the problem.
I think my search must go on there.
I got the same problem with my own pagination-code after updating to 3.4.