How to prevent getting blacklisted while scraping Amazon
<p>I try to scrape Amazon by Scrapy.
but  i have this error</p>

<pre><code>DEBUG: Retrying &lt;GET http://www.amazon.fr/Amuses-bouche-Peuvent-b%C3%A9n%C3%A9ficier-dAmazon-Premium-Epicerie/s?ie=UTF8&amp;page=1&amp;rh=n%3A6356734031%2Cp_76%3A437878031&gt; 
(failed 1 times): 503 Service Unavailable
</code></pre>

<p>I think that it's because = Amazon is very good at detecting bots.
How can i prevent this? </p>

<p>i used          <code>time.sleep(6)</code> before every request.</p>

<p>I don't want to use their API. </p>

<p>I tried I use tor and <a href="https://www.irif.univ-paris-diderot.fr/~jch/software/polipo/" rel="noreferrer">polipo</a></p>