The issue was with the configuration in the Access Management on the token encryption. It was blank but for some reason the JWT header showed HS256, that was caused spring to look for the HS256 private key and fail. After I changed the setting to use RS256, everything started working.