The current WP versions expose interface for this and store locale in WPLANG option. Depending on your tools you could set it up during your spin up process (for example with WP CLI).
Older version used WPLANG constant in wp-config.php. I think it should still work on a fresh install (if you don’t have option set up) so you could include it in whatever process you use to write wp-config.php.