Hide text if not homepage

You can use is_paged()

…checks if page being displayed is “paged” and the current page number is greater than one. This is a boolean function, meaning it returns either TRUE or FALSE.

You can adjust your code as follows

<?php if( is_home() && !is_paged() ) : ?>
    <p>Some text</p>
<?php endif;?>