gitmyhub

scrapy-hcf

Python ★ 0 updated 10y ago ⑂ fork

Scrapy spider middleware to use Scrapinghub's Hub Crawl Frontier as a backend for URLs

No plain-English explanation yet — one is being written right now. Check back in a minute.