Guido van Rossum

ctok

C ★ 63 updated 6y ago

Expose CPython's tokenizer as a Python class

The explanation service is briefly unavailable. The repo facts above still work — try again shortly.

Open on GitHub →

Chat with this repo Simplify and Visualize This Repo Scan the safety of this repo Self Host this repo

Made with gitmyhub, a BitVibe Labs product. · Explanations powered by explaingit.

GitHub is a trademark of GitHub, Inc. gitmyhub is independent and not affiliated with or endorsed by GitHub. Public data is shown via the GitHub API.