Student Model
نموذج الطالب
نموذج أصغر وأخف يُدرَّب لمحاكاة مخرجات نموذج المعلم المرنة، فيرث معرفته في بنية أقل تكلفة قابلة للنشر.
A smaller, lighter model trained to mimic the teacher's soft outputs, inheriting its knowledge in a cheaper, deployable architecture.
Also translated asالشبكة الطالب، النموذج المُتعلِّم
First appears in this corpus in: Distilling the Knowledge in a Neural Network (2015)
Appears in these papers
- Alpaca: A Strong, Replicable Instruction-Following Model2023in the sky ✦
- Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020in the sky ✦
- Training Data-Efficient Image Transformers & Distillation Through Attention2021in the sky ✦
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data2024in the sky ✦
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data2024in the sky ✦
- Emerging Properties in Self-Supervised Vision Transformers2021in the sky ✦
- Emerging Properties in Self-Supervised Vision Transformers2021in the sky ✦
- DINOv2: Learning Robust Visual Features Without Supervision2023in the sky ✦
- DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019in the sky ✦
- DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019in the sky ✦
- Distilling the Knowledge in a Neural Network2015in the sky ✦
- When Does Label Smoothing Help?2019in the sky ✦
- When Does Label Smoothing Help?2019in the sky ✦
- Fast Inference from Transformers via Speculative Decoding2023in the sky ✦
- Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision2023in the sky ✦