How to use Scrapy with Django Application
There are a couple of articles on how to integrate Scrapy into a Django Application (or vice versa?). But most of them don’t cover a full complete example that includes triggering spiders from Django views. Since this is a web application, that must be our main goal. What do we need? Before we start, it is better to specify what we want and how we want it. Check this diagram:...