Retaining sidebar elements when switching themes

I am very new to blogging and know very little code. I do know html though. And so to edit my sidebar I just laid in the code into the themes index.php file. Fine. But when I switch themes obviously I lose my links. The admin interface is too tedious. Where can I lay in the link code for it to transfer to the new theme? Or is that possible?