Huge number of 404 pages getting spawned

No, do not delete the pages. That will not solve your problem. What you need to do is fix your permalink settings. This usually happens if your .htaccess file got deleted or something went wrong with the rewrite rules. Chances are the 404 plugin is was the culprit here.

You should flush your permalinks. Go to Settings => Permalinks, and click on the Save Changes button.

enter image description here

This will update your permalinks settings and flush rewrite rules. In most cases, this solution will fix the problem. However, if it does not work for you, then you probably need to update your .htaccess file manually.