Teacher Model
نموذج المعلم
نموذج كبير (أو مجموعة نماذج) مُدرَّب مسبقاً يُستخدم لتوليد أهداف مرنة تُوجِّه تدريب نموذج أصغر (الطالب).
A large pre-trained model (or ensemble) used to generate soft targets that guide the training of a smaller student model.
Also translated asالنموذج المُعلِّم، الشبكة المُعلِّمة
First appears in this corpus in: Highway Networks (2015)
Appears in these papers
- Alpaca: A Strong, Replicable Instruction-Following Model2023in the sky ✦
- Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020in the sky ✦
- Training Data-Efficient Image Transformers & Distillation Through Attention2021in the sky ✦
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data2024in the sky ✦
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data2024in the sky ✦
- Emerging Properties in Self-Supervised Vision Transformers2021in the sky ✦
- Emerging Properties in Self-Supervised Vision Transformers2021in the sky ✦
- DINOv2: Learning Robust Visual Features Without Supervision2023in the sky ✦
- DINOv2: Learning Robust Visual Features Without Supervision2023in the sky ✦
- DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019in the sky ✦
- DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019in the sky ✦
- Highway Networks2015in the sky ✦
- Distilling the Knowledge in a Neural Network2015in the sky ✦
- When Does Label Smoothing Help?2019in the sky ✦
- When Does Label Smoothing Help?2019in the sky ✦
- Fast Inference from Transformers via Speculative Decoding2023in the sky ✦
- Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision2023in the sky ✦