Does the customizer support multiple templates?

Yes, this is possible. Just add a callback to those mods that you want to appear on specific pages, like this:

$wp_customize->add_control( 'my_page_control', array(
    ...
    'active_callback' => 'is_page',
    ...
    ));

You will see this control in the customizer only if you are viewing a page. Don’t forget to adapt the css produced by this mod in such a way that it only applies to pages as well. More about contextual controls.