Gradient

التدرج التفاضلي

متجه المشتقات التفاضلية الذي يشير إلى اتجاه الصعود الأقصى للدالة الحسابية.

gradients

Also translated asمتجهة الميل الحسابي، معدل التغير الموجه، الانحدارات، متجهات الميل، الاتجاه التفاضلي، التدرجات، التدرّج

First appears in this corpus in: Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées (1847)

Appears in these papers

Asynchronous Methods for Deep Reinforcement Learning2016 in the sky ✦
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization2011 in the sky ✦
Adaptive Subgradient Methods for Online Learning and Stochastic Optimization2011 in the sky ✦
Adam: A Method for Stochastic Optimization2014 in the sky ✦
Decoupled Weight Decay Regularization2019 in the sky ✦
Parameter-Efficient Transfer Learning for NLP2019 in the sky ✦
Intriguing Properties of Neural Networks2014 in the sky ✦
ImageNet Classification with Deep Convolutional Neural Networks2012 in the sky ✦
Highly Accurate Protein Structure Prediction with AlphaFold2021 in the sky ✦
Mastering the Game of Go Without Human Knowledge2017 in the sky ✦
Mastering the Game of Go with Deep Neural Networks and Tree Search2016 in the sky ✦
Backpropagation Through Time: What It Does and How to Do It1990 in the sky ✦
Learning Representations by Back-Propagating Errors1986 in the sky ✦
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift2015 in the sky ✦
Practical Bayesian Optimization of Machine Learning Algorithms2012 in the sky ✦
Learning Long-Term Dependencies with Gradient Descent is Difficult1994 in the sky ✦
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model2022 in the sky ✦
A Learning Algorithm for Boltzmann Machines1985 in the sky ✦
BPR: Bayesian Personalized Ranking from Implicit Feedback2009 in the sky ✦
A Computational Approach to Edge Detection1986 in the sky ✦
A Computational Approach to Edge Detection1986 in the sky ✦
Classifier-Free Diffusion Guidance2022 in the sky ✦
Contriever: Unsupervised Dense Information Retrieval with Contrastive Learning2022 in the sky ✦
Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data2001 in the sky ✦
Cyclical Learning Rates for Training Neural Networks2017 in the sky ✦
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks2015 in the sky ✦
Continuous Control with Deep Reinforcement Learning2015 in the sky ✦
Reducing the Dimensionality of Data with Neural Networks2006 in the sky ✦
A Fast Learning Algorithm for Deep Belief Nets2006 in the sky ✦
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding2016 in the sky ✦
Deep Learning2015 in the sky ✦
Deep Speech 2: End-to-End Speech Recognition in English and Mandarin2015 in the sky ✦
DeepSeek-V3 Technical Report2024 in the sky ✦
Densely Connected Convolutional Networks2017 in the sky ✦
Diffusion Models Beat GANs on Image Synthesis2021 in the sky ✦
Diffusion Models Beat GANs on Image Synthesis2021 in the sky ✦
Deep Interest Network for Click-Through Rate Prediction2018 in the sky ✦
Emerging Properties in Self-Supervised Vision Transformers2021 in the sky ✦
Direct Preference Optimization: Your Language Model Is Secretly a Reward Model2023 in the sky ✦
Human-Level Control Through Deep Reinforcement Learning2015 in the sky ✦
Dropout: A Simple Way to Prevent Neural Networks from Overfitting2014 in the sky ✦
Dueling Network Architectures for Deep Reinforcement Learning2016 in the sky ✦
ELECTRA: Pre-Training Text Encoders as Discriminators Rather Than Generators2020 in the sky ✦
FaceNet: A Unified Embedding for Face Recognition and Clustering2015 in the sky ✦
Fast R-CNN2015 in the sky ✦
Enriching Word Vectors with Subword Information2017 in the sky ✦
Fully Convolutional Networks for Semantic Segmentation2015 in the sky ✦
Explaining and Harnessing Adversarial Examples2015 in the sky ✦
Explaining and Harnessing Adversarial Examples2015 in the sky ✦
Finetuned Language Models Are Zero-Shot Learners2022 in the sky ✦
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness2022 in the sky ✦
High-Dimensional Continuous Control Using Generalized Advantage Estimation2016 in the sky ✦
Generative Adversarial Networks2014 in the sky ✦
Semi-Supervised Classification with Graph Convolutional Networks2017 in the sky ✦
Gaussian Error Linear Units (GELUs)2016 in the sky ✦
Google's Neural Machine Translation System: Bridging the Gap Between Human and Machine Translation2016 in the sky ✦
The Graph Neural Network Model2009 in the sky ✦
Going Deeper with Convolutions2014 in the sky ✦
Language Models Are Few-Shot Learners2020 in the sky ✦
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017 in the sky ✦
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization2017 in the sky ✦
Greedy Function Approximation: A Gradient Boosting Machine2001 in the sky ✦
On the Difficulty of Training Recurrent Neural Networks2013 in the sky ✦
Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées1847 in the sky ✦
Méthode Générale pour la Résolution des Systèmes d'Équations Simultanées1847 in the sky ✦
Inductive Representation Learning on Large Graphs2017 in the sky ✦
Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets2022 in the sky ✦
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling2014 in the sky ✦
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification2015 in the sky ✦
Hindsight Experience Replay2017 in the sky ✦
Highway Networks2015 in the sky ✦
Highway Networks2015 in the sky ✦
Histograms of Oriented Gradients for Human Detection2005 in the sky ✦
Histograms of Oriented Gradients for Human Detection2005 in the sky ✦
An Information-Maximization Approach to Blind Separation and Blind Deconvolution1995 in the sky ✦
Curiosity-Driven Exploration by Self-Supervised Prediction2017 in the sky ✦
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures2018 in the sky ✦
Distilling the Knowledge in a Neural Network2015 in the sky ✦
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour2017 in the sky ✦
Layer Normalization2016 in the sky ✦
LightGBM: A Highly Efficient Gradient Boosting Decision Tree2017 in the sky ✦
Symbolic Discovery of Optimization Algorithms2023 in the sky ✦
LLaMA: Open and Efficient Foundation Language Models2023 in the sky ✦
LoRA: Low-Rank Adaptation of Large Language Models2021 in the sky ✦
Visualizing the Loss Landscape of Neural Nets2018 in the sky ✦
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks2019 in the sky ✦
The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks2019 in the sky ✦
Long Short-Term Memory1997 in the sky ✦
Mask R-CNN2017 in the sky ✦
Mixed Precision Training2018 in the sky ✦
mixup: Beyond Empirical Risk Minimization2018 in the sky ✦
Some Methods of Speeding Up the Convergence of Iteration Methods1964 in the sky ✦
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer2022 in the sky ✦
Tensor Programs V: Tuning Large Neural Networks via Zero-Shot Hyperparameter Transfer2022 in the sky ✦
MuZero: Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model2020 in the sky ✦
MuZero: Mastering Atari, Go, Chess and Shogi by Planning with a Learned Model2020 in the sky ✦
Natural Gradient Works Efficiently in Learning1998 in the sky ✦
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis2020 in the sky ✦
A Method for Solving the Convex Programming Problem with Convergence Rate O(1/k²)1983 in the sky ✦
A Neural Probabilistic Language Model2003 in the sky ✦
Neural Ordinary Differential Equations2018 in the sky ✦
Optimal Brain Damage1989 in the sky ✦
PaLM: Scaling Language Modeling with Pathways2022 in the sky ✦
Pixel Recurrent Neural Networks2016 in the sky ✦
Policy Gradient Methods for Reinforcement Learning with Function Approximation1999 in the sky ✦
Proximal Policy Optimization Algorithms2017 in the sky ✦
Prioritized Experience Replay2015 in the sky ✦
QLoRA: Efficient Finetuning of Quantized LLMs2023 in the sky ✦
RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020 in the sky ✦
Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks2020 in the sky ✦
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning1992 in the sky ✦
Rectified Linear Units Improve Restricted Boltzmann Machines2010 in the sky ✦
Deep Residual Learning for Image Recognition2015 in the sky ✦
RMSProp: Divide the Gradient by a Running Average of Its Recent Magnitude2012 in the sky ✦
Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation2014 in the sky ✦
Generative Modeling by Estimating Gradients of the Data Distribution2019 in the sky ✦
Segment Anything2023 in the sky ✦
Squeeze-and-Excitation Networks2018 in the sky ✦
Sequence to Sequence Learning with Neural Networks2014 in the sky ✦
A Stochastic Approximation Method1951 in the sky ✦
SGDR: Stochastic Gradient Descent with Warm Restarts2017 in the sky ✦
Shampoo: Preconditioned Stochastic Tensor Optimization2018 in the sky ✦
A Unified Approach to Interpreting Model Predictions2017 in the sky ✦
Sharpness-Aware Minimization for Efficiently Improving Generalization2021 in the sky ✦
Signature Verification Using a "Siamese" Time Delay Neural Network1993 in the sky ✦
Distinctive Image Features from Scale-Invariant Keypoints2004 in the sky ✦
Distinctive Image Features from Scale-Invariant Keypoints2004 in the sky ✦
Emergence of Simple-Cell Receptive Field Properties by Learning a Sparse Code for Natural Images1996 in the sky ✦
Spatial Transformer Networks2015 in the sky ✦
Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows2021 in the sky ✦
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity2022 in the sky ✦
Visualizing Data Using t-SNE2008 in the sky ✦
Learning to Predict by the Methods of Temporal Differences1988 in the sky ✦
Attention Is All You Need2017 in the sky ✦
Universal Language Model Fine-Tuning for Text Classification2018 in the sky ✦
Auto-Encoding Variational Bayes2013 in the sky ✦
Neural Discrete Representation Learning2017 in the sky ✦
Wasserstein GAN2017 in the sky ✦
Wide & Deep Learning for Recommender Systems2016 in the sky ✦
Understanding the Difficulty of Training Deep Feedforward Neural Networks2010 in the sky ✦
Understanding the Difficulty of Training Deep Feedforward Neural Networks2010 in the sky ✦
XGBoost: A Scalable Tree Boosting System2016 in the sky ✦
YOLOv3: An Incremental Improvement2018 in the sky ✦
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models2019 in the sky ✦
ZeRO: Memory Optimizations Toward Training Trillion Parameter Models2019 in the sky ✦