STW-Collection

Scrap The Web Collection.

This repo contains to scrap the following kind of websites :

1. Do you want to learn Scrapy? [ScrapScrapy] (https://github.com/tapasweni-pathak/STW-Collection/tree/master/ScrapScrapy) is gonna be your first scrapy project in that case.
2. If you want to scrap a simple website without any javascript or AJAX calls,you can have a look at [this] (https://github.com/tapasweni-pathak/STW-Collection/tree/master/SimpleScrapy) project. This uses CrawlSpider.
3. If you want to use selenium with scrapy, have a look at [this] (https://github.com/tapasweni-pathak/STW-Collection/tree/master/ScrapyWithSelenium) project.
4. You can refer [this] (https://github.com/tapasweni-pathak/STW-Collection/tree/master/ScrapyWithDjango/Forestessentialsindia) project, if you want to save to Django DB as you scrap.