Batch Size

حجم الدفعة الحسابية

إجمالي عدد عينات البيانات التي يتم معالجتها وحساب تدرجاتها معاً قبل كل عملية تحديث للأوزان البنيوية.

Batch Size

Also translated asسعة المجموعة الجزئية للمعالجة، النطاق العددي لحزمة التدريب

First appears in this corpus in: ImageNet Classification with Deep Convolutional Neural Networks (2012)

Appears in these papers

Decoupled Weight Decay Regularization2019 in the sky ✦
Parameter-Efficient Transfer Learning for NLP2019 in the sky ✦
ImageNet Classification with Deep Convolutional Neural Networks2012 in the sky ✦
ALIGN: Scaling Up Visual and Vision-Language Representation Learning with Noisy Text Supervision2021 in the sky ✦
ALIGN: Scaling Up Visual and Vision-Language Representation Learning with Noisy Text Supervision2021 in the sky ✦
Alpaca: A Strong, Replicable Instruction-Following Model2023 in the sky ✦
Barlow Twins: Self-Supervised Learning via Redundancy Reduction2021 in the sky ✦
BART: Denoising Sequence-to-Sequence Pre-Training for Natural Language Generation, Translation, and Comprehension2019 in the sky ✦
Practical Bayesian Optimization of Machine Learning Algorithms2012 in the sky ✦
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020 in the sky ✦
Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning2022 in the sky ✦
A ConvNet for the 2020s2022 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019 in the sky ✦
The Falcon Series of Open Language Models2023 in the sky ✦
Fusion-in-Decoder: Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering2021 in the sky ✦
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning2023 in the sky ✦
A Generalist Agent2022 in the sky ✦
Glow: Generative Flow with Invertible 1×1 Convolutions2018 in the sky ✦
Scaling Language Models: Methods, Analysis & Insights from Training Gopher2022 in the sky ✦
Scaling Language Models: Methods, Analysis & Insights from Training Gopher2022 in the sky ✦
Group Normalization2018 in the sky ✦
Group Normalization2018 in the sky ✦
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization2018 in the sky ✦
Large Batch Optimization for Deep Learning: Training BERT in 76 Minutes2019 in the sky ✦
Large Batch Optimization for Deep Learning: Training BERT in 76 Minutes2019 in the sky ✦
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour2017 in the sky ✦
LIMA: Less Is More for Alignment2023 in the sky ✦
Symbolic Discovery of Optimization Algorithms2023 in the sky ✦
Symbolic Discovery of Optimization Algorithms2023 in the sky ✦
LLaMA: Open and Efficient Foundation Language Models2023 in the sky ✦
Visualizing the Loss Landscape of Neural Nets2018 in the sky ✦
Mixed Precision Training2018 in the sky ✦
Momentum Contrast for Unsupervised Visual Representation Learning2020 in the sky ✦
OPT: Open Pre-Trained Transformer Language Models2022 in the sky ✦
OPT: Open Pre-Trained Transformer Language Models2022 in the sky ✦
Efficient Memory Management for Large Language Model Serving with PagedAttention2023 in the sky ✦
Efficient Memory Management for Large Language Model Serving with PagedAttention2023 in the sky ✦
RoBERTa: A Robustly Optimized BERT Pretraining Approach2019 in the sky ✦
RoBERTa: A Robustly Optimized BERT Pretraining Approach2019 in the sky ✦
Scaling Laws for Neural Language Models2020 in the sky ✦
Sentence-BERT: Sentence Embeddings Using Siamese BERT-Networks2019 in the sky ✦
A Simple Framework for Contrastive Learning of Visual Representations2020 in the sky ✦
A Simple Framework for Contrastive Learning of Visual Representations2020 in the sky ✦
Exploring Simple Siamese Representation Learning2021 in the sky ✦
Fast Inference from Transformers via Speculative Decoding2023 in the sky ✦
SwAV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments2020 in the sky ✦
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity2022 in the sky ✦
Toolformer: Language Models Can Teach Themselves to Use Tools2023 in the sky ✦
Robust Speech Recognition via Large-Scale Weak Supervision2022 in the sky ✦
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models2019 in the sky ✦