how to make wordpress change the title and keep page name?

You need to add the actual page title back in. Try this:

add_filter( 'get_the_archive_title', function ( $title ) {
    if( is_category() ) {
        $title="Department: ". single_cat_title( '', false );
    }
    return $title;
});