Optimizer

الـمُحسِّن

الخوارزمية المخصصة لتحديث الأوزان والانحيازات وتعديل قيمها بناءً على التدرجات المحسوبة.

Optimizer

Also translated asخوارزمية التحسين، آلية مواءمة الأوزان

First appears in this corpus in: Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées (1847)

Appears in these papers

Adaptive Subgradient Methods for Online Learning and Stochastic Optimization2011 in the sky ✦
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization2011 in the sky ✦
Adam: A Method for Stochastic Optimization2014 in the sky ✦
Decoupled Weight Decay Regularization2019 in the sky ✦
Neural Networks and the Bias/Variance Dilemma1992 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks2015 in the sky ✦
Deep Learning2015 in the sky ✦
Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real World2017 in the sky ✦
Finetuned Language Models Are Zero-Shot Learners2022 in the sky ✦
High-Dimensional Continuous Control Using Generalized Advantage Estimation2016 in the sky ✦
Gaussian Error Linear Units (GELUs)2016 in the sky ✦
Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées1847 in the sky ✦
Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets2022 in the sky ✦
Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets2022 in the sky ✦
Optimizing Neural Networks with Kronecker-Factored Approximate Curvature2015 in the sky ✦
Symbolic Discovery of Optimization Algorithms2023 in the sky ✦
Symbolic Discovery of Optimization Algorithms2023 in the sky ✦
LLaMA: Open and Efficient Foundation Language Models2023 in the sky ✦
LoRA: Low-Rank Adaptation of Large Language Models2021 in the sky ✦
Some Methods of Speeding Up the Convergence of Iteration Methods1964 in the sky ✦
A Method for Solving the Convex Programming Problem with Convergence Rate O(1/k²)1983 in the sky ✦
A Method for Solving the Convex Programming Problem with Convergence Rate O(1/k²)1983 in the sky ✦
QLoRA: Efficient Finetuning of Quantized LLMs2023 in the sky ✦
Ridge Regression: Biased Estimation for Nonorthogonal Problems1970 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
A Stochastic Approximation Method1951 in the sky ✦
SGDR: Stochastic Gradient Descent with Warm Restarts2017 in the sky ✦
Shampoo: Preconditioned Stochastic Tensor Optimization2018 in the sky ✦
Sharpness-Aware Minimization for Efficiently Improving Generalization2021 in the sky ✦
Sharpness-Aware Minimization for Efficiently Improving Generalization2021 in the sky ✦