How do I add a favicon that only shows during viewing of my plugin’s admin panel?

When you add your admin (sub)page, then you’re (hopfully) using add_*menu_page(). You can simply save its result in a var. This var is the $hook_suffix.

Then you can simply add your callback (that adds the favicon) to the admin_head-{$suffix} hook Source Link. As the plugins screenshot shows you, there’re also the load-{$hook_suffix}-hooks Source Link, which are a bit earlier.

Edit: To get better an insights and to “proof”, that this hook actually exists, you can use my »current admin info« plugin, which you can download on GitHub. It shows you which globals are set, as well as which contextual hooks are available and what their names are, on the admin page you’re currently viewing.

enter image description here

Example

Here’s how you’d do it in a procedural way. Inside an OOP architectured piece of code, you’d probably save it into a class var and then use this var to add your favicon action/callback.

function wpse61424_register_admin_page()
{
    $hook_suffix = add_menu_page( /* add arguments */ );
    add_action( "admin_head-{$hook_suffix}", 'wpse67424_parttime_favicon' );
}
function wpse67424_parttime_favicon()
{
    printf(
         '<link rel="shortcut icon" href="https://wordpress.stackexchange.com/questions/67424/%s" />'
        ,plugin_dir_url( 'favicon.ico' )
    );
}