Remove CSS & JS files from WordPress Main Page For Increase Pagespeed?

Does it work any better added to a hook with the conditionals inside?

function my_deregisters() {

  if ( !is_single() ) {
   remove_action('wp_head', 'wp_page_numbers_stylesheet');
   //wp_deregister_style( 'fancybox' ); // i think this can be removed
   //wp_deregister_script( 'fancybox' ); // i think this can be removed
   wp_dequeue_script('fancybox');      
   wp_dequeue_style('fancybox'); 
   remove_action('wp_print_scripts', 'mfbfw_load');
   remove_action('wp_print_styles', 'mfbfw_css');
   remove_action('wp_head', 'mfbfw_init');
   remove_action('wp_head', 'cforms_style');
 }

} 
add_action( 'wp_enqueue_scripts', 'my_deregisters', 100 );