Actually, comment_field should be outside the $fields array. It is treated separately from the group of other fields. So, when i call comment_form(), i have to pass $fields array as one argument and then comment_field as another one. This way the system will override the default comment field.
