Hook into add_user_role and update based on new and removed roles

I ended up just adding a second hook to remove_user_role using the same function

add_action( 'remove_user_role', 'update_user_department', 10, 1 );