Gerapy/Gerapy
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
vitorfs/woid
Simple news aggregator displaying top stories in real time
python-testing-crawler/python-testing-crawler
A crawler for automated functional testing of a web application
yukilzw/factory
Docker microservice & Crawler by scrapy
hackfengJam/ArticleSpider
Crawling zhihu, jobbole, lagou by Scrapy, and using Elasticsearch+Django to build a Search Engine website --- README_zh.md (including: implementation roadmap, distributed-crawler and coping with anti-crawling strategies).
liuhuanshuo/2020-nCov-anhui
2020新型冠状病毒疫情数据爬取、可视化、网站开发部署
kirilcvetkov92/Instagram-Crawler
Scraping instagram profile information
behnamhatami/stock
Tehran Stock Market Crawler and Analyzer
