Is it save to replace with in WordPress search form

Plugin should never rely on a specific markup for the form. The only part that can be implied is the name of the search field: s. I don’t think any good plugin would break if you use a button.

I have written themes without any submit button; and nothing was broken.