Upload Custom Mime Types in WordPress (SVG, WebP)

I have discovered the cause. The SVG document needs to contain the xml declaration in the file:

<?xml version="1.0" encoding="utf-8"?>