Help! I have the same request and the same problem, I have an image of the post instead of a button, but the problem is that it links always to itself!
I tried also to read this page: http://codex.wordpress.org/Function_Reference/get_category_link#Source_File
But then the image always links to category 0, no matter what category it belongs originally.