Setting the size itself does not crop the existing images. You need to regenerate the existing thumbnails too.
There are a couple of plugins for this, but I personally downloaded and used Regenerate Thumbnails. Install the plugin, and head over to Tools > Regenerate Thumbnails. There you can regenerate thumbnails for images that exist in your media library, replacing the old thumbnails.