Self-Supervised Learning

التعلم ذاتي الإشراف

نموذج تدريب يتعلم فيه النموذج من بيانات غير مُعنونة بحل مهمة تمهيدية مُولَّدة تلقائياً من البيانات ذاتها، كالتنبؤ بالرموز المُقنَّعة أو إعادة بناء المدخلات المُشوَّهة.

A training paradigm where the model learns from unlabeled data by solving a pretext task generated automatically from the data itself, such as predicting masked tokens or reconstructing corrupted inputs.

Also translated asالتعلم التلقائي بدون إشراف بشري، التعلم بالإشراف الذاتي، التعلم دون إشراف بشري، توليد البيانات المرجعية آلياً من المحتوى

First appears in this corpus in: On Lines and Planes of Closest Fit to Systems of Points in Space (1901)

Appears in these papers

Barlow Twins: Self-Supervised Learning via Redundancy Reduction2021 in the sky ✦
Barlow Twins: Self-Supervised Learning via Redundancy Reduction2021 in the sky ✦
BEiT: BERT Pre-Training of Image Transformers2021 in the sky ✦
BEiT: BERT Pre-Training of Image Transformers2021 in the sky ✦
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020 in the sky ✦
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020 in the sky ✦
Learning Transferable Visual Models from Natural Language Supervision2021 in the sky ✦
Unsupervised Visual Representation Learning by Context Prediction2015 in the sky ✦
Unsupervised Visual Representation Learning by Context Prediction2015 in the sky ✦
Representation Learning with Contrastive Predictive Coding2018 in the sky ✦
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks2015 in the sky ✦
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin2015 in the sky ✦
Emerging Properties in Self-Supervised Vision Transformers2021 in the sky ✦
Emerging Properties in Self-Supervised Vision Transformers2021 in the sky ✦
DINOv2: Learning Robust Visual Features Without Supervision2023 in the sky ✦
DINOv2: Learning Robust Visual Features Without Supervision2023 in the sky ✦
ELECTRA: Pre-Training Text Encoders as Discriminators Rather Than Generators2020 in the sky ✦
Curiosity-Driven Exploration by Self-Supervised Prediction2017 in the sky ✦
Curiosity-Driven Exploration by Self-Supervised Prediction2017 in the sky ✦
ImageBind: One Embedding Space to Bind Them All2023 in the sky ✦
ImageBind: One Embedding Space to Bind Them All2023 in the sky ✦
Masked Autoencoders Are Scalable Vision Learners2022 in the sky ✦
MusicLM: Generating Music From Text2023 in the sky ✦
MusicLM: Generating Music From Text2023 in the sky ✦
A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023 in the sky ✦
A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023 in the sky ✦
On Lines and Planes of Closest Fit to Systems of Points in Space1901 in the sky ✦
Unsupervised Representation Learning by Predicting Image Rotations2018 in the sky ✦
Unsupervised Representation Learning by Predicting Image Rotations2018 in the sky ✦
A Simple Framework for Contrastive Learning of Visual Representations2020 in the sky ✦
A Simple Framework for Contrastive Learning of Visual Representations2020 in the sky ✦
Exploring Simple Siamese Representation Learning2021 in the sky ✦
Exploring Simple Siamese Representation Learning2021 in the sky ✦
SwAV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments2020 in the sky ✦
SwAV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments2020 in the sky ✦
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer2019 in the sky ✦
Toolformer: Language Models Can Teach Themselves to Use Tools2023 in the sky ✦
Toolformer: Language Models Can Teach Themselves to Use Tools2023 in the sky ✦
VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning2021 in the sky ✦
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations2020 in the sky ✦
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations2020 in the sky ✦