Wrap all default widget into div tag

In the register_sidebar() call in functions.php.

Look for before_widget and after_widget and modify as appropriate. The code below is the default usage.

'before_widget' => '<li id="%1$s" class="widget %2$s">',
'after_widget'  => '</li>',