Add class to Reply button in Comments area

In your comments.php template file use wp_list_comments and set the parameter callback to your defined function that will generate the template. Inside the function you can style the comment reply link.

wp_list_comments codex
Further reading on comment display