get_terms with more than x post count

Give:

$terms = get_terms("my_taxonomy");
$count = count($terms);
if ( $count > 0 ){
    echo "<ul>";
    foreach ( $terms as $term ) {
        if ($term->count > 2) {
            echo "<li>" . $term->name . "</li>";
        }
    }
    echo "</ul>";
}

a shot. It will grab all the terms and then run a check to see if the $term->count is greater than 2 and if so, print out those terms.