Answering my own question…
I figured it would be something simple. I had assumed that the videos I was trying to embed had ‘allow embedding’ activated. They didn’t. When you edit the video in Youtube Studio, go to the “Advanced” tag and click “Allow Embedding”. It’s the only way a Youtube video will show in the Gutenberg YT block.
