How to remove/hide Yoast’s “SEO” tab in admin panel?

This should hide it for everyone but the admin. If you run into any issues, you can use a plugin like Advanced Access Manager to get the job done. With that you will have more control of what each user level has access to.

function hide_yoastseo() {
if ( !current_user_can( 'administrator' ) ) :
    remove_action('admin_bar_menu', 'wpseo_admin_bar_menu',95);
    remove_menu_page('wpseo_dashboard');
endif;
}
add_action( 'admin_init', 'hide_yoastseo');