I was busy writing up a plugin for this without even checking of one already existed. So I did a little research and found out that it does indeed already exist and that the path I was going down was the right one. Well, there’s no need to reinvent the wheel here, so here’s the link to the existing plugin.
http://wordpress.org/extend/plugins/expire-password/
Does what you need – I tested it myself.