gitmyhub

scrapy-cluster

Python ★ 1 updated 9y ago ⑂ fork

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

No plain-English explanation yet — one is being written right now. Check back in a minute.