The plugins folder is shared. You can install one copy of the plugin and activate it on three blogs and not the others.
If you don;t want the others to be aware of the plugin’s existence… you’ll have to use another plugin to exclude it.
http://wordpress.org/extend/plugins/restrict-multisite-plugins/
or