gitmyhub

Awesome-Knowledge-Distillation-of-LLMs

★ 0 updated 1y ago ⑂ fork

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

No plain-English explanation yet — one is being written right now. Check back in a minute.