I have a feeling that modifying that table is not a good idea.
I hadn’t done something like this, but if I needed to deal with considerable amount of meta information for terms I’d try to leverage Metadata API, which for terms would involve setting up separate storage table.