That’s the purpose of admin area, isn’t it? 🙂
In WordPress Settings API is mostly responsible for creating and processing admin area pages. It’s not the friendliest part of core though to be honest.
I would look around for notification-related plugins, your requirements seem generic enough for good chances of finding something fitting.