Note that there are some explanatory texts on larger screens.

plurals
  1. POASP.NET HttpWebRequest - beginning today, rejected by Amazon with 503 exception
    primarykey
    data
    text
    <p>I have an affiliate account with Amazon and have been collecting information from the Amazon site for the purpose of sending them buyers. Today, I tested my site and found that all of the requests to Amazon failed. Here is the evidence:</p> <ol> <li>I am using ASP.NET (VB) HttpWebRequest to gather the data. Provide it a URL, then use HttpWebResponse / GetResponseStream to retrieve the page.</li> <li>Most of my Amazon data I get from the Amazon API (AWSECommerceService) - that service still works. Some data is not available from the API, which is why I resort to scraping.</li> <li>As of today, any HttpWebRequest to any page on Amazon (even the home page) returns a 503 (Server Unavailable) exception. Those pages are all visible in any browser.</li> <li>Every other Web site that I access still works (eBay, Barnes &amp; Noble, etc.), so the problem is only with Amazon.</li> </ol> <blockquote> <p>Postulate: Amazon has programmed its Web site to reject automated inquiries. <br />Is there any way to spoof the system and convince Amazon to send the page?<br /> Thanks and kudos to anyone who can shed some light!</p> </blockquote> <p>NOTE: in researching the problem, I saw a suggestion to add a UserAgent parameter to the HttpWebRequest. I tried using a UserAgent code for IE8, but it made no difference. (UserAgent code found at <a href="http://msdn.microsoft.com/en-us/library/system.net.httpwebrequest.useragent.aspx" rel="nofollow">http://msdn.microsoft.com/en-us/library/system.net.httpwebrequest.useragent.aspx</a>)</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
 

Querying!

 
Guidance

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload