Encoder

المُرمِّز

مكوِّن شبكة عصبية يحوّل المدخل الخام (نص، صورة، صوت) إلى تمثيل داخلي مضغوط (تضمين) يلتقط سماته الجوهرية.

A neural network component that transforms raw input (text, image, audio) into a compact internal representation (embedding) that captures its essential features.

Also translated asالترميز، الـمُدمِج البنيوي، الـمُرمِّز، المشفِّر، المُشفِّر، حزمة التشفير، مرمِّز، وحدة الترميز

First appears in this corpus in: A Mathematical Theory of Communication (1948)

Appears in these papers

ALIGN: Scaling Up Visual and Vision-Language Representation Learning with Noisy Text Supervision2021 in the sky ✦
Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware2023 in the sky ✦
Atlas: Few-shot Learning with Retrieval Augmented Language Models2023 in the sky ✦
Neural Machine Translation by Jointly Learning to Align and Translate2014 in the sky ✦
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting2021 in the sky ✦
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting2021 in the sky ✦
Barlow Twins: Self-Supervised Learning via Redundancy Reduction2021 in the sky ✦
BART: Denoising Sequence-to-Sequence Pre-Training for Natural Language Generation, Translation, and Comprehension2019 in the sky ✦
BEiT: BERT Pre-Training of Image Transformers2021 in the sky ✦
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2018 in the sky ✦
beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework2017 in the sky ✦
BLIP-2: Bootstrapping Language-Image Pre-Training with Frozen Image Encoders and Large Language Models2023 in the sky ✦
A Learning Algorithm for Boltzmann Machines1985 in the sky ✦
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020 in the sky ✦
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020 in the sky ✦
Chronos: Learning the Language of Time Series2024 in the sky ✦
Chronos: Learning the Language of Time Series2024 in the sky ✦
Learning Transferable Visual Models from Natural Language Supervision2021 in the sky ✦
ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT2020 in the sky ✦
Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning2022 in the sky ✦
Representation Learning with Contrastive Predictive Coding2018 in the sky ✦
Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017 in the sky ✦
DALL·E: Zero-Shot Text-to-Image Generation2021 in the sky ✦
DeBERTa: Decoding-Enhanced BERT with Disentangled Attention2020 in the sky ✦
DeBERTa: Decoding-Enhanced BERT with Disentangled Attention2020 in the sky ✦
Reducing the Dimensionality of Data with Neural Networks2006 in the sky ✦
DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networks2020 in the sky ✦
Extracting and Composing Robust Features with Denoising Autoencoders2008 in the sky ✦
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data2024 in the sky ✦
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data2024 in the sky ✦
Emerging Properties in Self-Supervised Vision Transformers2021 in the sky ✦
DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019 in the sky ✦
Are Transformers Effective for Time Series Forecasting?2023 in the sky ✦
Dense Passage Retrieval for Open-Domain Question Answering2020 in the sky ✦
Mastering Diverse Domains Through World Models2023 in the sky ✦
ELECTRA: Pre-Training Text Encoders as Discriminators Rather Than Generators2020 in the sky ✦
ELECTRA: Pre-Training Text Encoders as Discriminators Rather Than Generators2020 in the sky ✦
Deep Contextualized Word Representations2018 in the sky ✦
Fully Convolutional Networks for Semantic Segmentation2015 in the sky ✦
Fusion-in-Decoder: Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering2021 in the sky ✦
Glow: Generative Flow with Invertible 1×1 Convolutions2018 in the sky ✦
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding2018 in the sky ✦
Google's Neural Machine Translation System: Bridging the Gap Between Human and Machine Translation2016 in the sky ✦
Improving Language Understanding by Generative Pre-Training2018 in the sky ✦
GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints2023 in the sky ✦
Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection2023 in the sky ✦
HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels2022 in the sky ✦
Curiosity-Driven Exploration by Self-Supervised Prediction2017 in the sky ✦
ImageBind: One Embedding Space to Bind Them All2023 in the sky ✦
ImageBind: One Embedding Space to Bind Them All2023 in the sky ✦
Imagen: Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding2022 in the sky ✦
Informer: Beyond Efficient Transformer for Long Sequence Time Series Forecasting2021 in the sky ✦
Jukebox: A Generative Model for Music2020 in the sky ✦
Jukebox: A Generative Model for Music2020 in the sky ✦
High-Resolution Image Synthesis with Latent Diffusion Models2022 in the sky ✦
Layer Normalization2016 in the sky ✦
The Llama 3 Herd of Models2024 in the sky ✦
Masked Autoencoders Are Scalable Vision Learners2022 in the sky ✦
Mixed Precision Training2018 in the sky ✦
Momentum Contrast for Unsupervised Visual Representation Learning2020 in the sky ✦
Neural Ordinary Differential Equations2018 in the sky ✦
Variational Inference with Normalizing Flows2015 in the sky ✦
A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023 in the sky ✦
Image-to-Image Translation with Conditional Adversarial Networks2017 in the sky ✦
RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020 in the sky ✦
RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020 in the sky ✦
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks2020 in the sky ✦
REALM: Retrieval-Augmented Language Model Pre-Training2020 in the sky ✦
REALM: Retrieval-Augmented Language Model Pre-Training2020 in the sky ✦
Representation Learning: A Review and New Perspectives2013 in the sky ✦
Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation2014 in the sky ✦
Generative Modeling by Estimating Gradients of the Data Distribution2019 in the sky ✦
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers2021 in the sky ✦
Sequence to Sequence Learning with Neural Networks2014 in the sky ✦
A Mathematical Theory of Communication1948 in the sky ✦
Show and Tell: A Neural Image Caption Generator2015 in the sky ✦
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention2015 in the sky ✦
A Simple Framework for Contrastive Learning of Visual Representations2020 in the sky ✦
Exploring Simple Siamese Representation Learning2021 in the sky ✦
Video Generation Models as World Simulators2024 in the sky ✦
Fast Inference from Transformers via Speculative Decoding2023 in the sky ✦
SwAV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments2020 in the sky ✦
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer2019 in the sky ✦
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions2018 in the sky ✦
A Decoder-Only Foundation Model for Time Series Forecasting2024 in the sky ✦
Attention Is All You Need2017 in the sky ✦
Universal Language Model Fine-Tuning for Text Classification2018 in the sky ✦
U-Net: Convolutional Networks for Biomedical Image Segmentation2015 in the sky ✦
Auto-Encoding Variational Bayes2013 in the sky ✦
An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale2020 in the sky ✦
Neural Discrete Representation Learning2017 in the sky ✦
wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations2020 in the sky ✦
Robust Speech Recognition via Large-Scale Weak Supervision2022 in the sky ✦
World Models2018 in the sky ✦