How to hide CSS by default and show on button press

You can actually hide it on page load using jQuery ready() method:

$(document).ready(function(){
  $('#MY_WIDGET').hide();
});