Its more of a hack than actual solution. But, I am using it in a lot of themes without any issues.
.woocommerce div.product div.images .woocommerce-product-gallery__trigger {
visibility: hidden;
}
.woocommerce div.product div.images .woocommerce-product-gallery__trigger::before {
visibility: visible;
}
.woocommerce div.product div.images .woocommerce-product-gallery__trigger::after {
visibility: visible;
}
Please note I have removed the my styling from these psudo elements. You can now use any of the ::before
or ::after
psudo elements to make your own styles.