Gradient Descent

الانحدار التدريجي

خوارزمية أمثلة تهبط تدريجياً باتجاه القاع عبر تتبع عكس اتجاه التدرج لتقليل الخطأ.

Gradient Descent

Also translated asالنزول التدريجي، النزول المتدرج، الهبوط مع التدرج، خفض الخطأ عبر الميل، طريقة أشد انحدار، نزول التدرج

First appears in this corpus in: Nouvelles méthodes pour la détermination des orbites des comètes (Method of Least Squares) (1805)

Appears in these papers

A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting1997 in the sky ✦
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization2011 in the sky ✦
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization2011 in the sky ✦
Learning Representations by Back-Propagating Errors1986 in the sky ✦
Learning Representations by Back-Propagating Errors1986 in the sky ✦
Learning Long-Term Dependencies with Gradient Descent is Difficult1994 in the sky ✦
Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning2020 in the sky ✦
Gradient-Based Learning Applied to Document Recognition1998 in the sky ✦
Denoising Diffusion Probabilistic Models2020 in the sky ✦
Deep Learning2015 in the sky ✦
Emerging Properties in Self-Supervised Vision Transformers2021 in the sky ✦
Reconciling Modern Machine-Learning Practice and the Classical Bias–Variance Trade-Off2019 in the sky ✦
Deep Reinforcement Learning with Double Q-Learning2016 in the sky ✦
Human-Level Control Through Deep Reinforcement Learning2015 in the sky ✦
Explaining and Harnessing Adversarial Examples2015 in the sky ✦
3D Gaussian Splatting for Real-Time Radiance Field Rendering2023 in the sky ✦
Greedy Function Approximation: A Gradient Boosting Machine2001 in the sky ✦
On the Difficulty of Training Recurrent Neural Networks2013 in the sky ✦
Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées1847 in the sky ✦
Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées1847 in the sky ✦
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures2018 in the sky ✦
Optimizing Neural Networks with Kronecker-Factored Approximate Curvature2015 in the sky ✦
Optimizing Neural Networks with Kronecker-Factored Approximate Curvature2015 in the sky ✦
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour2017 in the sky ✦
Regression Shrinkage and Selection via the Lasso1996 in the sky ✦
Nouvelles méthodes pour la détermination des orbites des comètes (Method of Least Squares)1805 in the sky ✦
"Why Should I Trust You?": Explaining the Predictions of Any Classifier2016 in the sky ✦
Symbolic Discovery of Optimization Algorithms2023 in the sky ✦
Visualizing the Loss Landscape of Neural Nets2018 in the sky ✦
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks2019 in the sky ✦
Equation of State Calculations by Fast Computing Machines1953 in the sky ✦
Some Methods of Speeding Up the Convergence of Iteration Methods1964 in the sky ✦
Some Methods of Speeding Up the Convergence of Iteration Methods1964 in the sky ✦
Natural Gradient Works Efficiently in Learning1998 in the sky ✦
Natural Gradient Works Efficiently in Learning1998 in the sky ✦
A Method for Solving the Convex Programming Problem with Convergence Rate O(1/k²)1983 in the sky ✦
A Method for Solving the Convex Programming Problem with Convergence Rate O(1/k²)1983 in the sky ✦
No Free Lunch Theorems for Optimization1997 in the sky ✦
No Free Lunch Theorems for Optimization1997 in the sky ✦
Neural Tangent Kernel: Convergence and Generalization in Neural Networks2018 in the sky ✦
Neural Tangent Kernel: Convergence and Generalization in Neural Networks2018 in the sky ✦
RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020 in the sky ✦
Random Features for Large-Scale Kernel Machines2007 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
Shampoo: Preconditioned Stochastic Tensor Optimization2018 in the sky ✦
Shampoo: Preconditioned Stochastic Tensor Optimization2018 in the sky ✦
Sharpness-Aware Minimization for Efficiently Improving Generalization2021 in the sky ✦
Emergence of Simple-Cell Receptive Field Properties by Learning a Sparse Code for Natural Images1996 in the sky ✦
Image Style Transfer Using Convolutional Neural Networks2016 in the sky ✦
Image Style Transfer Using Convolutional Neural Networks2016 in the sky ✦
SwAV: Unsupervised Learning of Visual Features by Contrasting Cluster Assignments2020 in the sky ✦
Visualizing Data Using t-SNE2008 in the sky ✦
Learning to Predict by the Methods of Temporal Differences1988 in the sky ✦
Trust Region Policy Optimization2015 in the sky ✦
Approximation by Superpositions of a Sigmoidal Function1989 in the sky ✦
Auto-Encoding Variational Bayes2013 in the sky ✦