Momentum

الزخم

تقنية تسارع تراكمية تساعد خوارزمية الأمثلة على تجاوز العقبات الموضعية وتجنب التذبذب.

Momentum

Also translated asعزم القصور الحسابي، قوة الدفع التراكمية

First appears in this corpus in: Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées (1847)

Appears in these papers

Adaptive Subgradient Methods for Online Learning and Stochastic Optimization2011 in the sky ✦
Adam: A Method for Stochastic Optimization2014 in the sky ✦
Decoupled Weight Decay Regularization2019 in the sky ✦
ImageNet Classification with Deep Convolutional Neural Networks2012 in the sky ✦
Learning Representations by Back-Propagating Errors1986 in the sky ✦
Learning Representations by Back-Propagating Errors1986 in the sky ✦
Unsupervised Visual Representation Learning by Context Prediction2015 in the sky ✦
Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning2022 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks2015 in the sky ✦
Fully Convolutional Networks for Semantic Segmentation2015 in the sky ✦
Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées1847 in the sky ✦
Optimizing Neural Networks with Kronecker-Factored Approximate Curvature2015 in the sky ✦
Large Batch Optimization for Deep Learning: Training BERT in 76 Minutes2019 in the sky ✦
Large Batch Optimization for Deep Learning: Training BERT in 76 Minutes2019 in the sky ✦
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour2017 in the sky ✦
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour2017 in the sky ✦
Symbolic Discovery of Optimization Algorithms2023 in the sky ✦
Symbolic Discovery of Optimization Algorithms2023 in the sky ✦
Momentum Contrast for Unsupervised Visual Representation Learning2020 in the sky ✦
Some Methods of Speeding Up the Convergence of Iteration Methods1964 in the sky ✦
Some Methods of Speeding Up the Convergence of Iteration Methods1964 in the sky ✦
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer2022 in the sky ✦
A Method for Solving the Convex Programming Problem with Convergence Rate O(1/k²)1983 in the sky ✦
A Method for Solving the Convex Programming Problem with Convergence Rate O(1/k²)1983 in the sky ✦
QLoRA: Efficient Finetuning of Quantized LLMs2023 in the sky ✦
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation2018 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
SGDR: Stochastic Gradient Descent with Warm Restarts2017 in the sky ✦
Shampoo: Preconditioned Stochastic Tensor Optimization2018 in the sky ✦