Add core style in theme

wp_head() is absolutely required for WordPress themes. It is how your theme should be adding styles, and it’s how plugins can add their own scripts styles. Without it (and wp_footer(), which is also required) your theme will not function correctly.

WordPress does not load many styles itself, but the styles it does add are for markup created by the editor. The margin added to the HTML tag is to support the admin bar. Apart from the admin bar, emoji support, and the handful of editor styles, WordPress does not apply any additional styles to your theme.