Based on my testing and information from the developers, Gravatars won’t appear until you use the Gravatar Transfer feature to transfer the images to the local profile.
That feature can be enabled from Ultimate Member > Settings > Extensions. Once it’s activated, you can transfer the Gravatars from Ultimate Member > Gravatar Transfer.
You’ll need to run that feature periodically in order to keep the Gravatars up to date.