As the commenters have alluded to, this is a “feature” of using cookies. Changes to cookies are only enacted on the next page refresh.
You could try adding an extra page refresh (which will make the users browser page flash) or you could add some JavaScript to destroy the cookie dynamically.