Stochastic Gradient Descent (SGD)

الانحدار التدريجي العشوائي

نسخة سريعة من الانحدار التدريجي تحدّث الأوزان بالاعتماد على عينة عشوائية واحدة في كل خطوة.

Also translated asالهبوط الاحتمالي مع التدرج، تحسين الميل العشوائي

First appears in this corpus in: Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées (1847)

Appears in these papers

Adaptive Subgradient Methods for Online Learning and Stochastic Optimization2011 in the sky ✦
Adam: A Method for Stochastic Optimization2014 in the sky ✦
Decoupled Weight Decay Regularization2019 in the sky ✦
ImageNet Classification with Deep Convolutional Neural Networks2012 in the sky ✦
Neural Networks and the Bias/Variance Dilemma1992 in the sky ✦
BPR: Bayesian Personalized Ranking from Implicit Feedback2009 in the sky ✦
Unsupervised Visual Representation Learning by Context Prediction2015 in the sky ✦
A ConvNet for the 2020s2022 in the sky ✦
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data2001 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
Deep Learning2015 in the sky ✦
Deep Learning2015 in the sky ✦
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin2015 in the sky ✦
DeepWalk: Online Learning of Social Representations2014 in the sky ✦
Deep Interest Network for Click-Through Rate Prediction2018 in the sky ✦
FaceNet: A Unified Embedding for Face Recognition and Clustering2015 in the sky ✦
Enriching Word Vectors with Subword Information2017 in the sky ✦
Fully Convolutional Networks for Semantic Segmentation2015 in the sky ✦
3D Gaussian Splatting for Real-Time Radiance Field Rendering2023 in the sky ✦
GloVe: Global Vectors for Word Representation2014 in the sky ✦
Greedy Function Approximation: A Gradient Boosting Machine2001 in the sky ✦
On the Difficulty of Training Recurrent Neural Networks2013 in the sky ✦
Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées1847 in the sky ✦
Optimizing Neural Networks with Kronecker-Factored Approximate Curvature2015 in the sky ✦
Large Batch Optimization for Deep Learning: Training BERT in 76 Minutes2019 in the sky ✦
Large Batch Optimization for Deep Learning: Training BERT in 76 Minutes2019 in the sky ✦
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour2017 in the sky ✦
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour2017 in the sky ✦
Visualizing the Loss Landscape of Neural Nets2018 in the sky ✦
Visualizing the Loss Landscape of Neural Nets2018 in the sky ✦
Matrix Factorization Techniques for Recommender Systems2009 in the sky ✦
Some Methods of Speeding Up the Convergence of Iteration Methods1964 in the sky ✦
Some Methods of Speeding Up the Convergence of Iteration Methods1964 in the sky ✦
Natural Gradient Works Efficiently in Learning1998 in the sky ✦
Neural Collaborative Filtering2017 in the sky ✦
A Method for Solving the Convex Programming Problem with Convergence Rate O(1/k²)1983 in the sky ✦
A Neural Probabilistic Language Model2003 in the sky ✦
node2vec: Scalable Feature Learning for Networks2016 in the sky ✦
Policy Gradient Methods for Reinforcement Learning with Function Approximation1999 in the sky ✦
Proximal Policy Optimization Algorithms2017 in the sky ✦
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation2018 in the sky ✦
Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
A Stochastic Approximation Method1951 in the sky ✦
SGDR: Stochastic Gradient Descent with Warm Restarts2017 in the sky ✦
SGDR: Stochastic Gradient Descent with Warm Restarts2017 in the sky ✦
Shampoo: Preconditioned Stochastic Tensor Optimization2018 in the sky ✦
Sharpness-Aware Minimization for Efficiently Improving Generalization2021 in the sky ✦
Sharpness-Aware Minimization for Efficiently Improving Generalization2021 in the sky ✦
Exploring Simple Siamese Representation Learning2021 in the sky ✦
Visualizing Data Using t-SNE2008 in the sky ✦
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction2018 in the sky ✦
UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction2018 in the sky ✦
Auto-Encoding Variational Bayes2013 in the sky ✦
End-to-End Training of Deep Visuomotor Policies2016 in the sky ✦
Distributed Representations of Words and Phrases and Their Compositionality2013 in the sky ✦