Updating servers at once in web cluster

I don’t think the database schema ever changes so drastically that the versions of wordpress on box 2 + 3 would be prevented from reading from the DB after you’ve updated on box 1, however it depends what version you are upgrading from.

Why not set a similar environment locally and test upgrading site 1, while still trying to visit site 2.