WordPiece
WordPiece
خوارزمية تجزئة تقسم الكلمات إلى وحدات فرعية شائعة لتقليل حجم المفردات مع تغطية الكلمات النادرة.
A subword tokenization algorithm that splits words into common subword units to reduce vocabulary size while covering rare words.
Also translated asتقطيع الكلمات الفرعي، تجزئة وورد بيس
First appears in this corpus in: Neural Machine Translation of Rare Words with Subword Units (2016)
Appears in these papers
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2018in the sky ✦
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2018in the sky ✦
- Neural Machine Translation of Rare Words with Subword Units2016in the sky ✦
- RoBERTa: A Robustly Optimized BERT Pretraining Approach2019in the sky ✦