Multisite subdirecty added inside URL to uploaded files

I moved the entire uploads directory to the default location.

Not sure exactly why a standard WP install can easily move the uploads folder but a multisite install causes this problem, but there it is. I removed the line in the wp-config file and also moved the directory on the server.