When deleting a comment it’s possible to use the second input argument:
wp_delete_comment( $comment, $force_delete = true )
to delete it permanently and avoiding the trash bin. You could try to adjust your scheduled script accordingly.
There’s also the EMPTY_TRASH_DAYS constant, that’s default set to empty the trash bin after 30 days, but it will affect comments, posts, pages and other post types.