Knowledge distillation
A research field
Knowledge distillation is gaining ground in AI research: 0.8% to 1.0% of new AI papers, +0.3 points. It ranks #6 of 44 by gain in share. As of Oct 10, 2026.
- Change in share
- +0.3 pts
- Share, last 3 months
- 1.0%
- Papers, last 3 months
- 344
- Ready for products
- 2.4 / 5
Ideas in this field
On policy distillation0.2% → 0.3%+0.2 ptsOn policy self distillation0.0% → 0.2%+0.1 ptsReasoning distillation0.1% → 0.0%0.0 ptsMulti teacher distillation0.0% → 0.1%0.0 ptsTeacher student learning0.0% → 0.0%0.0 ptsChain of thought distillation0.0% → 0.0%0.0 ptsSelf distillation0.0% → 0.0%0.0 ptsCross modal knowledge distillation0.0% → 0.0%0.0 ptsDistribution matching distillation0.0% → 0.0%0.0 ptsDiffusion distillation0.0% → 0.0%0.0 pts
Companies working on it
Knowledge distillation: quick answers
Yes. Its share of new AI papers went from 0.8% to 1.0%, with 344 papers in the last 3 months.