Editing the nav menu?

The wp_nav_menu function supports multiple styling parameters, http://codex.wordpress.org/Function_Reference/wp_nav_menu

For instance you can add a $menu_id and then style the CSS for each <li> along the lines of border-right:1px solid; . Another option is to just add a “|” for the $link_after parameter, but you should probably use the ascii HTML entity value for it which is &#124;.