How do I avoid color distortion of uploaded images?

You must use standard color profiles, and convert your color profile to sRGB (in Photoshop -> Save for the web -> convert to sRGB checkbox).

You should also set quality compression to 100

add_filter('jpeg_quality', function($arg){return 100;});