Awesome Knowledge Distillation
-
Updated
May 25, 2026
Awesome Knowledge Distillation
Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
[ECCV2022] Factorizing Knowledge in Neural Networks
Multiple Generation Based Knowledge Distillation: A Roadmap
Official implementation of "Learn From One Specialized Sub-Teacher: One-to-One Mapping for Feature-Based Knowledge Distillation" accepted in EMNLP-Findings 2023
Automatically build and incrementally update LinkML ontologies (T-Box + A-Box) from TXT, Markdown, PDF, and DOCX documents using LLMs from multiple providers, with multi-format export and provenance tracking.
Systematic ablation of Logit-KD vs Feature-KD on CIFAR-10: ResNet-50 → ResNet-18 compression with 12-configuration hyperparameter sweep.
Code Reproduction of the essay Distillation Decision Tree
Multi-modal deep learning for Human Activity Recognition 7 architectures, SHAP explainability, robustness analysis · PyTorch
To associate your repository with the knowldge-distillation topic, visit your repo's landing page and select "manage topics."