I just found out what I was doing wrong. Apparently you have to place archive pages in the root folder of your theme.
I placed them in a subfolder called templates. This works for page templates with a template name, but not for taxonomy.php, archive.php, single.php etc.
