Next Sentence Prediction (NSP)
التنبؤ بالجملة التالية (NSP)
مهمة تدريب مسبق ثنائية التصنيف تتنبأ هل الجملة الثانية تتبع الأولى فعلاً في النص الأصلي أم لا.
A binary pre-training task predicting whether the second sentence actually follows the first in the original text.
Also translated asتنبؤ تتابع الجمل، تصنيف العلاقة بين الجمل
First appears in this corpus in: BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding (2018)
Appears in these papers
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2018in the sky ✦
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2018in the sky ✦
- DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019in the sky ✦
- RoBERTa: A Robustly Optimized BERT Pretraining Approach2019in the sky ✦
- XLNet: Generalized Autoregressive Pretraining for Language Understanding2019in the sky ✦