Keeping LaTeX contents in line with non-latex text

I haven’t used that plugin, so I can’t speak to whether there are any configurations that would help. However, I think your issue could be solved with a simple css rule:

img.latex {
    vertical-align: middle;
}

would center all your LaTeX-generated images on the line they fall on.