So after researching some wordpress filters i found the teeny_mce_buttons and removed the distraction free button with this function.
function remove_teeny_mce_btns($buttons) {
unset($buttons[13]);
return $buttons;
}
add_filter('teeny_mce_buttons', 'remove_teeny_mce_btns');
Here is the link with the solution:
https://www.gavick.com/blog/wordpress-tinymce-custom-buttons