$args = array(
'taxonomy' => 'special',
'posts_per_page' => -1,
'author' => 2
);
$author_category_posts = new WP_Query($args);
$count_of_posts_by_author = $author_category_posts->post_count;
You can fetch the number of posts made by that author in specific taxonomy.