Set per_page
to 5 and page
to 1 in wp_list_comments
http://codex.wordpress.org/Function_Reference/wp_list_comments
Then add your read more link just below your comments to reload the page with per_page
and page
not set. You can do this with AJAX for smoothness.