Empty your trash 🙂
Pages are not removed from the custom menus until they’ve been deleted completely.
I’ve tested it right now.
Creating a complex nav menu can take a very long time and the pages can be bulk deleted in a sec. I believe WordPress is just trying to save you all the trouble in case of an accident.
Deleted categories are removed from nav menus instantly.