Order Taxonomy Term by date created

Maybe you just need to add:

'order'   => 'DESC', //or ASC

depending on which order you want them to be.

The title of your question sounds like you are trying to order taxonomy terms by their creation date which is not possible, but you can work around it by using the ID.

For example:

 $terms = get_terms( 'YOUR_TAX_TERM', $args );

Since taxonomy term IDs are created incrementally if you sort by ID you are sorting them in the order that they were created:

$args = array(
    'orderby'    => 'ID', 
    'order'      => 'DESC',
);

While not technically ordering by the date, this will accomplish essentially the same thing.