Why is the admin bar appearing (on certain pages) for non logged-in users?

Since I think that mis-identifying all users not-logged in is extremely unlikely, my line of thought is that wrong non-public version of page was cached for some reason.