WordPress.org

Go to the "My Category Order" tab under Manage and specify your desired order for post categories

If you are using widgets then replace the standard "Category" widget with the "My Category Order" widget. That's it.

If you aren't using widgets, modify sidebar template to use correct orderby value: wplistcategories('orderby=order&title_li=');