Gradient Clipping
تقليم التدرجات الحسابية
تقنية تقص وتحدد السقف الرقمي الأعلى لقيم التدرجات لمنع مشكلة الانفجار الحسابي للمشتقات أثناء التدريب.
Gradient Clipping
Also translated asتحديد السقف الأقصى لمتجهات الميل، كبح الانفجار التدرجي عدديًا
First appears in this corpus in: Learning Long-Term Dependencies with Gradient Descent is Difficult (1994)
Appears in these papers
- Learning Long-Term Dependencies with Gradient Descent is Difficult1994in the sky ✦
- Learning Long-Term Dependencies with Gradient Descent is Difficult1994in the sky ✦
- Fast R-CNN2015in the sky ✦
- On the Difficulty of Training Recurrent Neural Networks2013in the sky ✦
- On the Difficulty of Training Recurrent Neural Networks2013in the sky ✦
- Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling2014in the sky ✦
- Symbolic Discovery of Optimization Algorithms2023in the sky ✦
- Neural Turing Machines2014in the sky ✦
- OPT: Open Pre-Trained Transformer Language Models2022in the sky ✦
- Recurrent Neural Networks (RNNs): A Gentle Introduction and Overview2019in the sky ✦
- Sequence to Sequence Learning with Neural Networks2014in the sky ✦