So after some digging managed to find the asnwer and instead of removing the filter you can overrid the single_template filter to add your own custom template.
add_filter( 'single_template', 'my_custom_single_template', 99, 1 );
function my_custom_single_template( $single ) {
global $post;
if ( isset( $post ) && $post->post_type == 'hotel-room' ) {
$single = require_once( STYLESHEETPATH . '/single-hotel-room.php');
}
return $single;
}