I can display a menu from another blog by switch_to_blog($blog_id) and then calling wp_nav_menu() and then restore_current_blog().
Is there a way to do essentially the same thing but call get_sidebar($sidebar_name) and get the whole sidebar from that blog?