Causal Mask
قناع سببي
مصفوفة عزل تحجب الكلمات المستقبلية أثناء عملية تدريب النماذج التوليدية لضمان التعلم السببي الصحيح خطياً.
Also translated asحجب الكلمات المستقبلية في التوليد، محدد التتابع التراجعي للأمام، قناع الترابط السببي النصي، قناع الاتجاه الواحد، القناع التسلسلي
First appears in this corpus in: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2018)
Appears in these papers
- BART: Denoising Sequence-to-Sequence Pre-Training for Natural Language Generation, Translation, and Comprehension2019in the sky ✦
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2018in the sky ✦
- BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer2019in the sky ✦
- BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer2019in the sky ✦
- Decision Transformer: Reinforcement Learning via Sequence Modeling2021in the sky ✦
- Decision Transformer: Reinforcement Learning via Sequence Modeling2021in the sky ✦
- FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning2023in the sky ✦
- FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning2023in the sky ✦
- Improving Language Understanding by Generative Pre-Training2018in the sky ✦
- Mistral 7B2023in the sky ✦
- OPT: Open Pre-Trained Transformer Language Models2022in the sky ✦
- A Decoder-Only Foundation Model for Time Series Forecasting2024in the sky ✦