Positional Embedding
التضمين الموضعي
متجهات تضاف للوحدات اللغوية لتزويد نموذج المحول بمعلومات حول ترتيب وموقع الكلمة في الجملة.
Positional Embedding
Also translated asصياغة الأبعاد المكانية للرمز، التضمين الرقمي للمواقع، الترميزات الموضعية، تضمينات موضعية
First appears in this corpus in: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2018)
Appears in these papers
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2018in the sky ✦
- BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer2019in the sky ✦
- BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer2019in the sky ✦
- Emerging Properties in Self-Supervised Vision Transformers2021in the sky ✦
- ELECTRA: Pre-Training Text Encoders as Discriminators Rather Than Generators2020in the sky ✦
- Improving Language Understanding by Generative Pre-Training2018in the sky ✦
- Language Models Are Few-Shot Learners2020in the sky ✦
- Masked Autoencoders Are Scalable Vision Learners2022in the sky ✦
- A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023in the sky ✦
- A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023in the sky ✦
- An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale2020in the sky ✦
- Robust Speech Recognition via Large-Scale Weak Supervision2022in the sky ✦