I’ve received my answer from Woocommerce support. It’s working like a charm:
add_action( 'after_setup_theme', 'my_stop_cancelled_restock', 0 );
function my_stop_cancelled_restock() {
remove_action('woocommerce_order_status_cancelled', 'wc_maybe_increase_stock_levels');
}