Where can I find the definitive list of core blocks in html form

There’s no definitive list that I’m aware of. If you want to get the markup for a block the only reliable way to do that is to insert it into the editor and then copy the result to the clipboard.

You cannot assume that all blocks are “<!-- wp: plus post-title plus optional attributes {tag: something} plus /-->“, as many blocks also include HTML that they depend on. For example, the image block looks like this:

<!-- wp:image {"id":1934,"sizeSlug":"full","linkDestination":"none"} -->
<figure class="wp-block-image size-full"><img src="https://example.test/wp-content/uploads/2023/01/image-1.jpg" alt="" class="wp-image-1934"/></figure>
<!-- /wp:image -->

Just using the <!-- part would not be sufficient.