Set the container to be empty. 🙂
wp_nav_menu( array(
'menu_class' => 'tlm',
'theme_location' => 'primary-menu',
'container' => ''
) );
Please refer to the function reference to review all the arguments that you can pass to wp_nav_menu().