StreamObserver
Rust
★ 2
updated 27d ago
Proof of concept for a streaming input, concurrent output, no-compaction inferencing implementation based on the StreamingLLM paper
No plain-English explanation yet — one is being written right now. Check back in a minute.