easy-crawler

Python ★ 8 updated 8y ago

A simple, stable, scalable and swift general web crawler.

No plain-English explanation yet — one is being written right now. Check back in a minute.