Yes its possible. To override WooCommerce template files in your theme (or child theme) simply make a folder named woocommerce
within your theme directory, and then create the folders/template file you wish to override within it.
This link overriding templates is having the procedure to override templates via a theme.