wp_remote_get() and javascript/noscript situation

This result is expected since wp_get_remote() doesn’t include a Javascript engine.

It should give you the same result as the View Source option in your browser and fetch the plain HTML document.

It looks like the page your are trying to fetch, is loading a Javascript file, in the header tag, to render the content:

<html>
    <head>
        <script src="https://wordpress.stackexchange.com/js/load-content.js"></script>
    </head>
    <body>
        <noscript>Your browser doesn't support Javascript!</noscript>
    </body>
</html>

So you should get both the script and the noscript part.

What you are looking for is called headless browsing.

If you want to run the Javascript, you might want to take a look at solutions like: PhantomJS

PhantomJS is a headless WebKit scriptable with a JavaScript API.

[…] One major use case of PhantomJS is headless testing of web
applications. It is suitable for general command-line based testing,
within a precommit hook, and as part of a continuous integration
system.

There exists many test frameworks for PhantomJS, like Jasmine, Mocha and QUnit.

Alternatively: Try to load the Javascript file with wp_remote_get() and see if you can extract the content that way 😉

Related Posts:

  1. Order & Orderby Parameters
  2. Add a class with body_class to a specific url with parameter
  3. Post title as link parameter
  4. How to change window ratio in teachpress “tplist”
  5. Trying to use add_action and do_action with parameters
  6. How to wp_upload_bits() to a sub-folder?
  7. Open WordPress ‘Add New Post’ admin page with parameters set via $_GET
  8. Pulling a parameter out of the URL of a WP link without “?” or being sent to a different page
  9. HTTP request on localhost failing
  10. Why does WordPress automatically redirect URLs with the parameter “name=” to a different page?
  11. wp_remote_get vs. file_get_contents vs. cURL?
  12. wp_remote_get() not retrieving pages properly
  13. CPT archive 404ing when using a custom taxonomy name as a variable
  14. How to get the generated query string of wp_remote_get?
  15. wp_remote_get returns an error for valid URL
  16. Any way to use a custom Parameter for youtube embed without using an iframe?
  17. Add attribute to existing Shortcode
  18. oEmbed vimeo with add_query_arg parameters not inserted to HTML
  19. Any way to use a custom Parameter for vimeo embed without using an iframe?
  20. How do I execute a wp_remote_get call using NTLM authentication?
  21. Is there any background process that I can run from plugin without depending on page hits on a website without affecting page-load speed?
  22. Passing a parameter to a permalink
  23. Determine WP_Query parameters from URL
  24. How do I know what variables are passed in a filter/action and what their meaning is?
  25. Can we access the REST request parameters from within the permission_callback to enforce a 401 by returning false?
  26. Trying to get an api request getting error 404
  27. Wp Login redirect strips parameters from url
  28. Use wp_remote_get to add image to media library
  29. append url parameters to all links
  30. Use wp_remote_get to get JSON instagram feed from public profile
  31. using wp_remote_get to retrieve own url on local host
  32. REST API parameters not working with nginx
  33. Returning a value from a PHP page
  34. On Plugin Activation, How Do I Check for Proper Transport Mechanism?
  35. Query string parameters from custom fields, inconsistent results
  36. wp_parse_args & category parameter
  37. Add custom parameter to REST API request of a custom post type?
  38. How to add parameter to wp_enqueue_script?
  39. Using several add_action with parameters inside a class
  40. How do I retain url parameters the entire time a user browses my site?
  41. Get value from shortcode to do something
  42. Is there a link parameter that will show me all my published pages?
  43. wp_remote_get – curl error 28 connection timed out – using SANS in URL
  44. wp_remote_get times out on api request but jquery GET and postman work?
  45. wp_remote_get sslv3 alert handshake failure
  46. How to add URL-Parameter for Javascript Widgets?
  47. How to return hook data when multiple parameters are present?
  48. WordPress get parameter ‘unapproved’ and ‘moderation-hash’
  49. Where would I put my call to wp_remote_get?
  50. array_filter warning – wp-includes/post.php line 3148
  51. Fetching data from another website results in a slow website?
  52. Errors on a single host using wp_remote_get() unless sslverify is set to false
  53. Does anyone know all parameters of get_comments()
  54. http_response_timeout filter not working
  55. @file_get_contents and wp_remote_get
  56. Where is this function’s callback getting its arguments from?
  57. How to run wp_remote_get() inside of a loop for multiple page API response?
  58. Can I pass parameters to the add_shortcode() function?
  59. WordPress HTTP API NTLM Authentication
  60. How to create custom search result page with custom URL parameters for custom post type?
  61. Get param from shortcode in plugin function
  62. wp_remote instead of file_get_contents on non json
  63. query_posts with meta_value
  64. Wrapping add_query_arg with esc_url not working
  65. What is wrong with my WP_Query Arguments?
  66. How to pass on a value as parameter via url to another page
  67. how get number of twitter followers in wordpress
  68. calling admin-ajax.php from admin-ajax.php
  69. Adding a Tag Parameter / Filter to My Shortcode
  70. Issues with downloading a file with wp_remote_get()
  71. Pre-existing arguments when using queries
  72. Need help creating asynchronous data scraper in WordPress
  73. Adding query parameter to archive page returns 404
  74. Accidently changed the GUID
  75. RTrouble passing arguments to action
  76. Display value of the GET parameter in a new URL page
  77. Why “?v=hash” is added to my URLs? [closed]
  78. How to construct a dynamic rewrite rule for child pages that passes more than one query var
  79. Show data obtained from a function and place it in a shortocode function
  80. How can I pass instance via apply_filters as a parameter?
  81. Get posts from year from URL
  82. add_action with associative array
  83. Set A Cookie To URL Parameter, Pass Cookie From Page To Page To Alter Post
  84. Set URL Parameter Post Layout As Default
  85. How to pass username in url
  86. Url parameter going to 404 not found
  87. Add a url parameter to the current post and read it in a shortcode
  88. How do I rewrite URL that has custom parameter
  89. Daily automatic update of stock quotes via REST API and Cronjob. Or is there a more sophisticated way?
  90. Shortcode not interpreted if parameter set
  91. append current user-id to all internal permalinks
  92. Why get_terms() behaves strangely when being called in admin (for use in meta box)?
  93. How to pass parameter that ends up being part of a class name with wordpress shortcode
  94. wp_remote_get() never fires
  95. How to use wp_remote_get in place of file_get_contents?
  96. problem in query_vars parameters
  97. Is it possible to change a shortcode parameter based on a media query?
  98. Problem getting wp posts in plugin with wp_remote_get
  99. append $_GET parameters to post
  100. How to use the HTTP API (wp_remote_get) instead of cURL?