How can I restrict a custom WordPress role access to only a specific plugin?

You can use User Admin Simplifier plugin. It allows you to hide plugins and options from choosen users.