Is it possible to get rid of the wrapping divs on a block component?

No, there’s no way to remove that div from the RadioControl component. You can see in the source for the component that there are no options that will control whether that div is rendered. It will always be rendered when using that particular component.

Depending on what you actually need to do you could just use the display: contents CSS rule to essentially make the browser ignore the wrapping div.