Convert WordPress to static website by using the pages generated by the caching plugin?

There is no general method of doing this that works for all plugins. And no generic WordPress steps to take or officially supported paths.

Each plugin requires a unique answer and solution that is very specific to that plugin. Some plugins may not support this, while others already depend on doing this. You would need to enquire with the specific plugin vendor via their support routes/documentation, or ask other users.