Easiest way to run scrapy crawler so it doesn't block the script
<p><a href="http://doc.scrapy.org/en/latest/topics/practices.html#run-from-script" rel="nofollow">The official docs</a> give many ways for running <code>scrapy</code> crawlers from code:</p>

<pre><code>import scrapy
from scrapy.crawler import CrawlerProcess

class MySpider(scrapy.Spider):
    # Your spider definition
    ...

process = CrawlerProcess({
    'USER_AGENT': 'Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1)'
})

process.crawl(MySpider)
process.start() # the script will block here until the crawling is finished
</code></pre>

<p>But all of them block script until crawling is finished. What's the easiest way in python to run the crawler in a non-blocking, async manner?</p>