Portfolio

Student Capacity Moderates Knowledge Distillation Effectiveness

Systematic study of knowledge distillation across ResNet teacher-student pairs on CIFAR-10. Identifies student capacity — not teacher-student accuracy gap — as the key moderating factor in KD effectiveness. Accompanied by a peer-reviewed arXiv publication.