Is it possible to remove the gutenberg duotone effect on hover?

Yes.

[class*="wp-block"][class]:hover > img {
  filter: none;
}

That ruleset works for hover on either Image or Cover blocks but you may want to write less generic selector for it depending on your intent.