Byte Pair Encoding (BPE)

ترميز زوج البايت

خوارزمية تجزئة نصوص تبني قاموسها عبر دمج أزواج الأحرف أو الرموز الأكثر تكراراً في المدونة اللغوية بانتظام.

Also translated asخوارزمية التجزئة القائمة على تكرار الأحرف، التشفير الثنائي لتوليد القواميس الفرعية

First appears in this corpus in: ELIZA — A Computer Program for the Study of Natural Language Communication (1966)

Appears in these papers

BART: Denoising Sequence-to-Sequence Pre-Training for Natural Language Generation, Translation, and Comprehension2019 in the sky ✦
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model2022 in the sky ✦
Neural Machine Translation of Rare Words with Subword Units2016 in the sky ✦
Neural Machine Translation of Rare Words with Subword Units2016 in the sky ✦
DALL·E: Zero-Shot Text-to-Image Generation2021 in the sky ✦
ELIZA — A Computer Program for the Study of Natural Language Communication1966 in the sky ✦
The Falcon Series of Open Language Models2023 in the sky ✦
The Falcon Series of Open Language Models2023 in the sky ✦
Enriching Word Vectors with Subword Information2017 in the sky ✦
Enriching Word Vectors with Subword Information2017 in the sky ✦
Google's Neural Machine Translation System: Bridging the Gap Between Human and Machine Translation2016 in the sky ✦
Google's Neural Machine Translation System: Bridging the Gap Between Human and Machine Translation2016 in the sky ✦
Improving Language Understanding by Generative Pre-Training2018 in the sky ✦
Language Models Are Unsupervised Multitask Learners2019 in the sky ✦
Language Models Are Unsupervised Multitask Learners2019 in the sky ✦
Language Models Are Few-Shot Learners2020 in the sky ✦
The Llama 3 Herd of Models2024 in the sky ✦
The Llama 3 Herd of Models2024 in the sky ✦
Mistral 7B2023 in the sky ✦
Mistral 7B2023 in the sky ✦
OPT: Open Pre-Trained Transformer Language Models2022 in the sky ✦
OPT: Open Pre-Trained Transformer Language Models2022 in the sky ✦
RoBERTa: A Robustly Optimized BERT Pretraining Approach2019 in the sky ✦
Sequence to Sequence Learning with Neural Networks2014 in the sky ✦
Robust Speech Recognition via Large-Scale Weak Supervision2022 in the sky ✦