How to fetch the Response object of a Request synchronously on Scrapy?
<p>I believe using "callback" method is asynchronous, please correct me if I'm wrong. I'm still new with Python so please bear with me.</p>

<p>Anyway, I'm trying to make a method to check if a file exists and here is my code:</p>

<pre><code>def file_exists(self, url):
    res = False;
    response = Request(url, method='HEAD', dont_filter=True)
    if response.status == 200:
        res = True
    return res
</code></pre>

<p>I thought the Request() method will return a Response object but it still returns a Request object, to capture the Response, I have to create a different method for the callback.</p>

<p>Is there a way to get the Response object within the code block where you call the Response() method?</p>