Speculative-Decoding
Python
★ 9
updated 2y ago
My own implementation of "Fast Inference from Transformers via Speculative Decoding"
No plain-English explanation yet — one is being written right now. Check back in a minute.