Latency
زمن الاستجابة (التأخير البيني)
مقياس زمن التأخير البيني ويحسب الوقت المستغرق منذ إدخال الأمر وحتى بدء استقبال أولى إجابات ومخرجات النموذج.
Latency
Also translated asالوقت المستغرق لإنتاج أولى المخرجات، فترة الانتظار التشغيلية للنموذج
First appears in this corpus in: Deep Speech 2: End-to-End Speech Recognition in English and Mandarin (2015)
Appears in these papers
- ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT2020in the sky ✦
- Deep Speech 2: End-to-End Speech Recognition in English and Mandarin2015in the sky ✦
- DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019in the sky ✦
- DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019in the sky ✦
- Billion-Scale Similarity Search with GPUs2017in the sky ✦
- HuggingGPT: Solving AI Tasks with ChatGPT and Its Friends in Hugging Face2023in the sky ✦
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications2017in the sky ✦
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications2017in the sky ✦
- Efficient Memory Management for Large Language Model Serving with PagedAttention2023in the sky ✦
- Efficient Memory Management for Large Language Model Serving with PagedAttention2023in the sky ✦
- ZeRO: Memory Optimizations Toward Training Trillion Parameter Models2019in the sky ✦