Perplexity

معيار الحيرة الاحتمالية

معيار قياس إحصائي يحسب مدى ارتباك وحيرة النموذج أثناء التنبؤ؛ فالقيم الأقل تعني استيعاباً وفهماً أفضل للنص.

Perplexity

Also translated asمقياس الارتباك في التنبؤ اللغوي، مؤشر جودة استيعاب النموذج للنص

First appears in this corpus in: Latent Dirichlet Allocation (2003)

Appears in these papers

Atlas: Few-shot Learning with Retrieval Augmented Language Models2023 in the sky ✦
BART: Denoising Sequence-to-Sequence Pre-Training for Natural Language Generation, Translation, and Comprehension2019 in the sky ✦
Emergent Abilities of Large Language Models2022 in the sky ✦
Are Emergent Abilities of Large Language Models a Mirage?2023 in the sky ✦
Scaling Language Models: Methods, Analysis & Insights from Training Gopher2022 in the sky ✦
Language Models Are Unsupervised Multitask Learners2019 in the sky ✦
GPTQ: Accurate Post-Training Quantization for Generative Pre-Trained Transformers2022 in the sky ✦
GPTQ: Accurate Post-Training Quantization for Generative Pre-Trained Transformers2022 in the sky ✦
Latent Dirichlet Allocation2003 in the sky ✦
LIMA: Less Is More for Alignment2023 in the sky ✦
LLM.int8(): 8-Bit Matrix Multiplication for Transformers at Scale2022 in the sky ✦
Mamba: Linear-Time Sequence Modeling with Selective State Spaces2023 in the sky ✦
Mistral 7B2023 in the sky ✦
Mixtral of Experts2024 in the sky ✦
A Neural Probabilistic Language Model2003 in the sky ✦
A Neural Probabilistic Language Model2003 in the sky ✦
OPT: Open Pre-Trained Transformer Language Models2022 in the sky ✦
RETRO: Improving Language Models by Retrieving from Trillions of Tokens2022 in the sky ✦
Shampoo: Preconditioned Stochastic Tensor Optimization2018 in the sky ✦
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity2022 in the sky ✦
Visualizing Data Using t-SNE2008 in the sky ✦
Visualizing Data Using t-SNE2008 in the sky ✦
Toolformer: Language Models Can Teach Themselves to Use Tools2023 in the sky ✦
Toolformer: Language Models Can Teach Themselves to Use Tools2023 in the sky ✦
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction2018 in the sky ✦