Comment displaying full name even after setting another display name?

Did you try to visit your site as an anonymous user, because the field “display name publicly as” should work in comment sections too.
Try opening a “private navigation” window from your favorite browser and check.