How to create user groups and allow custom posts and plugin modify/access to specific group?

You’d use roles for this. You’d create a new role that has the required access and then assign anyone you want to be in that role ‘group’.

The User Role Editor plugin should give you the functionality you need to create the access you require.