How do I integrate my Django project with Scrapy?

Question

I’m looking to develop a simple project using Django where I will create a web page and this page will capture data from other pages. The problem is that I cannot integrate the Scrapy with Django.

Answer 1

Possibility to use Scrapy’s pipeline to integrate directly with Django models (link).

It is also possible to run your Spider as a script that returns a json to you' (link). In the link example some functions will probably be 'deprecated', but the doc is enough to start.