icetk

Python ★ 153 updated 3y ago

A unified tokenization tool for Images, Chinese and English.

No plain-English explanation yet — one is being written right now. Check back in a minute.