How to make pages that arent indexed for ajax applications

You can use the constant DOING_AJAX to check if a current request is AJAX or not. This would let you do something like this in your templates:

if ( DOING_AJAX ) {
    //show your content
} else {
    //return 404 error
    global $wp_query;
    $wp_query->set_404();
}