How to use the HTTP API (wp_remote_get) instead of cURL?

So it looks like I’ve managed to fix my own problem here. I don’t know if this is the best thinkable solution to this exact problem, but it does work!

My assumptions about CURLOPT_FOLLOWLOCATION seem correct. As Sally CJ also explained in the comments, the default setting in WP is always set to false. That’s why the data always contained contents from the (302) redirect instead of the actual targeted URL.

I’ve found this old thread and answer where the underlying CURLOPT_FOLLOWLOCATION is changed through the http_api_curl action. Using this action to override the default setting was the key for fixing my problem with wp_remote_get. With the function enabled (see below), my returned data is exactly the same as when using cURL.

function __set_curl_to_follow( &$handle ) {
    curl_setopt( $handle, CURLOPT_FOLLOWLOCATION, true );  
}
add_action( 'http_api_curl', '__set_curl_to_follow' );

Special thanks to Sally CJ and bosco for thinking with me on this!

Related Posts:

  1. Why does WP HTTP API switch the method (POST/PURGE) to GET when redirecting (302)?
  2. How to force a 404 on WordPress
  3. WordPress redirecting connections on port 8080 to 80
  4. Disable ONLY URL auto complete, not the whole canonical URL system
  5. 301 redirect instead of 404 when URL is a prefix of a post or page name?
  6. Redirecting WordPress /.htaccess / HSTS / SSL
  7. Correct way to hide pseudo pages from being shown?
  8. Htaccess redirect from ‘/%postname%.html’ to ‘/%postname%’
  9. Redirect to post after submission with Gravity Forms? [closed]
  10. Redirect www to non-www htaccess
  11. Stop WordPress Redirection From /keyword to /some-post-containing-keyword/
  12. Specific URL has 403 Forbidden status code
  13. Using redirection plugin to pass URLs as lowercase to wordpress
  14. Prevent redirect to page/page when reserved term ‘name’ in $_POST when value is a page/post title
  15. Redirect to login page
  16. I want to redirect the url to the previous page
  17. Headers already sent – WordPress core
  18. Import WordPress Post Slug with Forward Slash
  19. Create a php callback/endpoint for an OAuth script
  20. Query WP data with the WPDB API from outside WordPress
  21. Get the final destination after WP_Http redirects (WordPress)
  22. Why specific file directory fails to redirect but its parent folder succeeds?
  23. Cant Access Website – Changed HTTP to HTTPs
  24. How to remove “YEAR/MONTH/” from uploads URL & redirect old URL to the new form?
  25. How to redirect user to a page after form submission
  26. How does WordPress redirect without using .htaccess?
  27. How do I redirect a user when he is logged in after clicking on a menu
  28. How to redirect from various ?page_id= to home page?
  29. Redirect 301 www.my-site.com/page/n to www.my-site.com/ [closed]
  30. Redirect not logged in users if they are on a specific page
  31. How to set up a single portfolio page as home page?
  32. 301 Redirect To Post ID
  33. How code a redirect back to page from form thanks
  34. How to add new redirection on wordpress site
  35. htaccess redirect invoice.php to /client/invoice.php
  36. redirecting and showing notice from previous action
  37. Make posts 410 dynamically
  38. Redirect user to a form until they have filled it out [closed]
  39. Buddyboss Platform plugin causing “too many redirects”
  40. Always redirect current user to certain page
  41. How to redirect to clean links with this code
  42. How can I make my WordPress site redirect to subdomain once successfully login they will redirect back to root domain
  43. Unable to access folders in same level as wordpress installation
  44. 301 Redirect all page and post urls from .html to /
  45. wordpress_redirect returns different headers for HEAD and GET requests
  46. Login/Register redirect user with message
  47. Blog has an infinite redirect loop
  48. WP forwarding to wrong site address
  49. wp_login_form redirect problem
  50. Redirect from ip to domain
  51. How can I redirect users on the new 404 page without plugin?
  52. How do I write a subdomain redirect?
  53. How does WordPress format the url on a 301 when a trailing slash is missing?
  54. Redirection on domain name
  55. Redirect only Blog posts to new
  56. htaccess redirect from specific urls of my site to the homepage
  57. Unwanted slug in my website
  58. HTTPS to HTTP rewrite rules not working as expected
  59. Changing permalinks and redirecting urls
  60. Preventing Canonical Redirect for CDN
  61. htaccess 301 Redirect not working from aspx to new WP permalink
  62. Mass .htaccess URL Forwarding
  63. Redirecting simple big problem
  64. Wp Remote get with manual redirect
  65. 302 Redirect is showing in the audit but links are opening separately
  66. Add base folder to CPT and 301
  67. Conditional Login Redirect
  68. wp_logout_url redirect not working
  69. How do i make WordPress return 404 instead of redirecting on misspelled page?
  70. how to redirect non logged users to login page and redirect to another page with saved data?
  71. How to redirect if 404 error in wordpress then redirect 404.php url
  72. WP Redirect with Wild Card Characters
  73. How to automatically redirect category pages (301) when changing the location of a category in the hierarchy
  74. Automatically switch language based on visitor’s country
  75. Do redirect 301 for wordpress page
  76. How to redirect user to Referrer Page using wp_signon in Custom Login Page in WordPress
  77. How to make front page temporarily show content of internal page
  78. custom error message or redirect to custom page if any error occurs
  79. redirect after account activation for forum using bbpress and buddypress
  80. redirect_to ignoring the SSL
  81. Resolving the too many redirects on wordpress
  82. Redirect wordpress website URL into other link
  83. Serve wordpress regardless of the cname
  84. Pass original URL through after login redirect
  85. redirects for removed/deleted woocommerce products
  86. Headers already sent error after upgrading wordpress to 4.2.2
  87. How to block direct access to files upload in edd folder
  88. Blog post URL redirects to a Page URL who’s slug is a prefix of the post slug.
  89. Subpages return 404 server error
  90. Converted posts to a CPT, 301 redirects necessary?
  91. Accept (once only) policy page on login
  92. Rewrite rule to redirect to a particular filename.php
  93. Redirect to other page when mobile
  94. website is sending people to wrong address
  95. woocommerce shop page Redirect Help
  96. Forcing header cache control in 404 pages
  97. Regex for pdf’s – Old .asp Site folder structure to new WordPress Media Folder(s)
  98. Create a custom redirect link that tracks the first visited page and after submitting form goes to first page using formidable forms plugin? [closed]
  99. WordPress not use site url when redirect 301
  100. Redirect certain 404 pages to parent page