Combine Scrapy with Django or isolate them

I have a Django application running at AWS ,I want to have a Scrapy crawler program to fetch data and insert into the Django application database.

Now I have 2 options ,either combine Scrapy with Django or build a isolated Scrapy project and directly insert data into data without through Django's Model.

I'm wondering which option is better ,I personal prefer isolating these 2 projects.There are 2 reasons:

1.I have no experience to combine Scrapy with Django.

2.Lower the risk, if one die another one can still alive.

Any suggestion?

Back to Top