The best approach is to serve the smaller image sizes, that is what matters to the end user. If you do the math on something like 5 slider images (large ones) you will see a pretty significant difference. Image sizes are in most cases the largest request.
The downside is simply having more storage on your server, but that doesn’t effect the end-user nor is it expensive.