You can try the Front End Editor
plugin that allows administrators to edit content in-place. If you don’t like that in particular try 8 WordPress Plugins that enable posting and editing from the front-end
Logging in is still a must. You can login from front as well, though.
See: