You can add a custom menu item link to the menu on Appearance => Menus => Edit Menus => Links. Specify the URL which shows all videos and Link text and click Add to Menu. Once added, save the menu and you should see a new menu item on the site end pointing to the videos list.
