How to create a plugin page that shows XML?

I am not sure how your “public” requirements combines with context of admin.

In general easiest way to create page with very customized markup is to use custom named template.