Python3 urllib3 crawler - can't limit max connections to aa single domain
<p>I am using python3 urllib3 in order to build a crawler to download multiple urls.</p>

<p>On my main activity i create 20 threads of that using <strong>the same (one) instance</strong> of my <code>Downloader</code> class which uses one instance of <code>PoolManager</code>:</p>

<pre><code>def __init__(self):
    self.manager = PoolManager(num_pools=20)
</code></pre>

<p>I've tried submitting the same url over and over again and i see at the log that it creates a lot of connections to the same domain. I've tried to limit number of pools (<code>num_pools=1</code>) and it still creating multiple connections to the same url. On the documentation i understood that the <code>PoolManager</code> creates a new connection if the other connections to the same domain are being used.</p>

<p>I want to limit the number of connection to a single domain. Using up to 2 different connections is what a normal browser use so it is safe. How can i do that?</p>