Try removing they value from your meta query:
$args = array(
'orderby' => 'display_name',
'meta_query' => array(
array(
'key' => 'member',
'compare' => '!=',
),
),
);
$users = get_users($args);