Using the “Latest posts” feature on a different site

You could insert the plugin’s shortcode into another page, by following the directions here.
http://wordpress.org/extend/plugins/nurelm-get-posts/

Alternatively if you don’t necessarily need the plugin and simply want to create a page that displays posts, follow the example given here on the codex.
http://codex.wordpress.org/Pages#A_Page_of_Posts

Scribu, +1 .. as that’s essentially what you were suggesting to.