One set of categories for multiple custom posts

The only thing you have to do is, instead of using different taxonomies per post type, use one shared/common between them. You’re setting up the post type to taxonomy relation either via the taxonomies parameter of register_post_type() or per usage of register_taxonomy_for_object_type, just change this, after reading the documentation, according to your needs.