Nope, that is not the issue with your website, according to the WooCommerce FAQ: What is the maximum WooCommerce can handle?
Sky is the limit. We’ve seen instances of shops with 100,000+ products
listed, handling thousands of transactions per minute. In those cases,
they had great hosting support and their own developer team focused on
optimization.