human_time_diff() returns “48 years ago” for all comments

You should use strtotime to turn the comment’s date into a string that can be compared with the current time. In your case, you should use:

echo human_time_diff( strtotime( $comment->comment_date ), current_time( 'timestamp', 1 ) );