If the only thing I use MySQL for is WordPress, do I need MySQL’s timezone tables?

WordPress only uses the tables it creates upon installation. Technically WP wouldn’t have a problem with removing tables that are not in the created tables. However, messing with the tables in the mysql database is not necessarily the best for MySQL itself. Also, if you are trying to optimize MySQL by removing tables and databases, you might want to look at alternative data storage.