Displaying PHP errors isn’t really a WordPress thing, it is more of a PHP thing directly. No, I don’t think you are crazy for wanting this, I had a similar need for a separate application and I wrote this blog post which should be helpful.
Essentially, define your own error handler.