Is there a wordpress filter to edit the markup of inline images?

You can click the vertical “…” menu > “Edit as HTML” and add your class there manually.

There is currently no other interface field to directly add a class to an inline image tag out of the box.

A plugin could overload the toolbox of the inline image, but currently only the width is editable.