In your main plugin file just define a constant containing the path of the plugin:
$pluginpath = plugin_dir_path( __FILE__ );
define('MY_AWESOME_PLUGIN_PATH', $pluginpath);
After that in your header.php
:
include(MY_AWESOME_PLUGIN_PATH . 'html_file_name.html');