crawdad

Go ★ 64 updated 7y ago

Cross-platform persistent and distributed web crawler :crab:

No plain-English explanation yet — one is being written right now. Check back in a minute.