User/Global/Network Admin Dashboard

I need to add a custom dashboard widget and remove other widgets to my multisite. i.e. to remove some widgets from the dashboard for each site I add this to my functions.php:

function remove_dashboard_widgets() {

	global $wp_meta_boxes;
	unset($wp_meta_boxes['dashboard']['side']['core']['dashboard_primary']);
	unset($wp_meta_boxes['dashboard']['side']['core']['dashboard_secondary']);
}
add_action('wp_dashboard_setup', 'remove_dashboard_widgets');

But for a multisite the network admin has another dashboard, and when users register for my site (they register for all blogs) they see a global dashboard and these widgets dont get removed.

Can someone please help me figure out where to add the code to remove these widgets from network admin and from the user/global dashboard and also if the code needs to be changed at all.

Thanks.