Remove standard meta boxes from custom taxonomy

Unfortunately not. These items are hard-coded into the wp-admin/edit-tags.php file. The best route is the route you didn’t want to go which is CSS.

You can replace category in the below array with a list of taxonomies you want to apply these styles to. The function checks the current taxonomy against this array and if it’s found will apply the CSS styles to hide these fields.

/**
 * Hide taxonomy fields per taxonomy
 *
 * @return void
 */
function wpse344725_taxonomy_css() {

    global $taxonomy;

    $modified_tax_arr = array( 'category' );

    if( empty( $taxonomy ) || ! in_array( $taxonomy, $modified_tax_arr ) ) {
        return;
    }

    ?>

        <style>
            .form-field.term-slug-wrap,
            .form-field.term-parent-wrap,
            .form-field.term-description-wrap   {display: none;}
        </style>

    <?php

}
add_action( 'admin_head', 'wpse344725_taxonomy_css' );

Additionally, with the above method you could remove them with JavaScript or hide them with any other CSS visibility property. I can’t think of a reason why you wouldn’t want to simply hide them in CSS maybe with more elaboration we can find a better solution.