GitHub - ChillarAnand/site_crawler: Simple spider to crawl a site and get all links from it!

Crawled my blog http://www.avilpage.com & stored all links to links.txt

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
site_crawler		site_crawler
Readme.md		Readme.md
links.txt		links.txt
scrapy.cfg		scrapy.cfg

Provide feedback