wp_set_post_terms() seems very slow

I’ve recently done a batch import of about 200 posts, with 5 taxonomies attached to them and each of the posts a few terms. It took about 5-10 seconds to do the whole batch.

So no, it shouldn’t be this slow.