duplodocus

Rust ★ 87 updated 2mo ago

Tooling for exact and MinHash deduplication of large-scale text datasets

No plain-English explanation yet — one is being written right now. Check back in a minute.