how could I have a user signing up for a blog, be assigned to that blog only

IIRC a User sings up on a multisite setup, he basically signs up on all sites. So that User is available to all sites whatever you do. But I can not see anything bad with that.

Maybe you need to specify why you want to block the User from using your multisite? What’s wrong with that?