I answered my own question I just implemented it wrong when testing it on my end (mis-typed the taxonomy).
This is correct:
// Change the number of posts that show up on the taxonomy template
function custom_tax_post_count ( $query ) {
if (($query->is_tax(array('taxonomy_1', 'taxonomy_2')) ))
$query->set( 'posts_per_page', '-1' );
}
add_action( 'pre_get_posts', 'custom_tax_post_count' );