Transfer Learning

نقل التعلم

استخدام المعرفة المُكتسبة من التدريب على مهمة أو مجموعة بيانات ما لتحسين الأداء على مهمة أخرى مختلفة، كاستخدام مرمِّز MAE المُدرَّب على ImageNet في كشف الأجسام على COCO.

Using knowledge acquired from training on one task or dataset to improve performance on a different task, such as using a MAE encoder trained on ImageNet for object detection on COCO.

Also translated asالتبادل المعرفي بين النماذج، التعلم الانتقالي، التعلم التحويلي، التعلم بالنقل، التعلّم بالنقل، انتقال التعلّم، توظيف المعرفة السابقة في مهام جديدة

First appears in this corpus in: ImageNet: A Large-Scale Hierarchical Image Database (2009)

Appears in these papers

Parameter-Efficient Transfer Learning for NLP2019 in the sky ✦
Parameter-Efficient Transfer Learning for NLP2019 in the sky ✦
ALIGN: Scaling Up Visual and Vision-Language Representation Learning with Noisy Text Supervision2021 in the sky ✦
Atlas: Few-shot Learning with Retrieval Augmented Language Models2023 in the sky ✦
Barlow Twins: Self-Supervised Learning via Redundancy Reduction2021 in the sky ✦
beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework2017 in the sky ✦
BLIP-2: Bootstrapping Language-Image Pre-Training with Frozen Image Encoders and Large Language Models2023 in the sky ✦
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model2022 in the sky ✦
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020 in the sky ✦
Chronos: Learning the Language of Time Series2024 in the sky ✦
Evaluating Large Language Models Trained on Code2021 in the sky ✦
Unsupervised Visual Representation Learning by Context Prediction2015 in the sky ✦
Unsupervised Visual Representation Learning by Context Prediction2015 in the sky ✦
Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning2022 in the sky ✦
A ConvNet for the 2020s2022 in the sky ✦
Training Data-Efficient Image Transformers & Distillation Through Attention2021 in the sky ✦
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data2024 in the sky ✦
DINOv2: Learning Robust Visual Features Without Supervision2023 in the sky ✦
Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World2017 in the sky ✦
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks2019 in the sky ✦
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks2019 in the sky ✦
Deep Contextualized Word Representations2018 in the sky ✦
Fully Convolutional Networks for Semantic Segmentation2015 in the sky ✦
Fully Convolutional Networks for Semantic Segmentation2015 in the sky ✦
A Generalist Agent2022 in the sky ✦
A Generalist Agent2022 in the sky ✦
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding2018 in the sky ✦
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding2018 in the sky ✦
Scaling Language Models: Methods, Analysis & Insights from Training Gopher2022 in the sky ✦
Improving Language Understanding by Generative Pre-Training2018 in the sky ✦
Group Normalization2018 in the sky ✦
HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends in Hugging Face2023 in the sky ✦
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset2017 in the sky ✦
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset2017 in the sky ✦
ImageNet: A Large-Scale Hierarchical Image Database2009 in the sky ✦
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures2018 in the sky ✦
Learning to Summarize from Human Feedback2020 in the sky ✦
Momentum Contrast for Unsupervised Visual Representation Learning2020 in the sky ✦
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer2022 in the sky ✦
Open X-Embodiment: Robotic Learning Datasets and RT-X Models2024 in the sky ✦
OPT: Open Pre-Trained Transformer Language Models2022 in the sky ✦
A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023 in the sky ✦
A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023 in the sky ✦
Textbooks Are All You Need2023 in the sky ✦
RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020 in the sky ✦
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014 in the sky ✦
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014 in the sky ✦
Representation Learning: A Review and New Perspectives2013 in the sky ✦
RoBERTa: A Robustly Optimized BERT Pretraining Approach2019 in the sky ✦
Unsupervised Representation Learning by Predicting Image Rotations2018 in the sky ✦
Unsupervised Representation Learning by Predicting Image Rotations2018 in the sky ✦
Segment Anything2023 in the sky ✦
Sentence-BERT: Sentence Embeddings Using Siamese BERT-Networks2019 in the sky ✦
Sharpness-Aware Minimization for Efficiently Improving Generalization2021 in the sky ✦
A Simple Framework for Contrastive Learning of Visual Representations2020 in the sky ✦
Exploring Simple Siamese Representation Learning2021 in the sky ✦
Exploring Simple Siamese Representation Learning2021 in the sky ✦
Image Style Transfer Using Convolutional Neural Networks2016 in the sky ✦
SwAV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments2020 in the sky ✦
Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows2021 in the sky ✦
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer2019 in the sky ✦
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer2019 in the sky ✦
A Decoder-Only Foundation Model for Time Series Forecasting2024 in the sky ✦
Universal Language Model Fine-Tuning for Text Classification2018 in the sky ✦
Universal Language Model Fine-Tuning for Text Classification2018 in the sky ✦
Very Deep Convolutional Networks for Large-Scale Image Recognition2014 in the sky ✦