poc-clip-tokeniser
Python
★ 0
updated 3y ago
Proof-of-Concept code with using CLIP tokeniser to encode/decode a prompt string, and visually show the token boundaries
No plain-English explanation yet — one is being written right now. Check back in a minute.