Create sidebar for all the categories and use sidebar in categories pages.
You can install Categories Sidebar directly from the WordPress admin panel.
Visit the Plugins > Add New and search for 'Categories Sidebar'. Click to install. Once installed, activate and it is functional.
Manual Installation Categories Sidebar plugin:
Download and unzip the file Upload the full extracted folder to the /wp-content/plugins/ directory Activate the plugin through the 'Plugins' menu in WordPress.
You're done! The Plugin ready to use according to the directions in the description.