The code used on wordpress.org to render readme files is here: class Markdown. You can download the class and the dependencies, then you should be able to set up a simple custom reader. If you want to see it as close as possible to the actual page, you can download/checkout per SVN the theme from the same place.
