Remove button from page if viewed through Customizer

You did not wrote if you want to check it using PHP or JavaScript but if using PHP you can add to your theme a below function it will return true if the page is previewed using Customizer

function is_customizer_preview() {
  if( isset( $_GET['customize_theme'] ) ) {
    return true;
  } else {
    return false;
  }
}

Then somewhere in the theme template files you can use it like that if you want to have an additional class in the body

<body class="some-classes <?php if(is_customizer_preview()): ?>my-customizer-class<?php endif; ?>">