There is no one format that works on all browsers, for example, Firefox won’t play MP4 files due to FF not having the license to use the MP4 codec.
You definitely need OGV and MP4 versions, the others will depend on other browsers and choice, it’s better to upload all versions to give you piece of mind the video will work for everyone.