How can I change “page” (as in foobar.com/page/5) to another word?

Try this:

function re_write_rules() {
    global $wp_rewrite;

    $wp_rewrite->pagination_base="group";
    $wp_rewrite->flush_rules();
}
add_action('init', 're_write_rules');