I think GeoMashup is the go-to plugin for something like this. http://wordpress.org/extend/plugins/geo-mashup/
I’ve used it for a similar site with great results. There’s a lot to dig into, it’s very flexible, but you’ll definitely be able to get what you want.