Make a child theme.
Copy category.php into your child theme.
Comment out lines 17, 33, 46, 48, and 50.
The category checks if you have any posts under that category and if not shows ‘Nothing Found’.
You’re essentially removing the if statement.
This will show the category title if there are not posts under this category.