Displaying Current Page Number Conditionally

You want to use is_paged which checks if the current page number is 2 or above (and returns true if it is). is_front_page checks ‘if the main page is a posts or a Page’.

You’ve also used incorrect syntax (changed from a double quote to a single quote, and used <?php inside a string being echoed).

Untested, but the following should do what you want:

<?php 
    $pageNumber = (get_query_var('paged')) ? get_query_var('paged') : 1;
    if(is_paged()) {
        echo "<div class="page-count"> &ndash;".$pageNumber." &ndash;</div>";
    }
?>