Turns out the “Custom Page Order” plugin was causing the randomization error… or rather, not allowing any randomization as it overrides it completely. Disabled the plug-in.
Whenever I need to change orders, I can enable the plugin, shuffle pages around, and then disable. But the need for this is decreasing more and more as we now have custom menu options in WordPress.