Residual Connection

الوصلة التجاوزية

مسار بنيوي يمرر المدخلات الأصلية مباشرة لطبقات متقدمة دون تعديل لحماية التدرجات.

Residual Connection

Also translated asاتصال تجاوزي، الرابط المباشر للبيانات، اتصال الفروق المتبقية، الاتصالات التجاوزية، اتصالات تجاوزية

First appears in this corpus in: Learning Representations by Back-Propagating Errors (1986)

Appears in these papers

Parameter-Efficient Transfer Learning for NLP2019 in the sky ✦
Parameter-Efficient Transfer Learning for NLP2019 in the sky ✦
Mastering the Game of Go Without Human Knowledge2017 in the sky ✦
Mastering the Game of Go Without Human Knowledge2017 in the sky ✦
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting2021 in the sky ✦
Learning Representations by Back-Propagating Errors1986 in the sky ✦
Learning Long-Term Dependencies with Gradient Descent is Difficult1994 in the sky ✦
BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer2019 in the sky ✦
BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer2019 in the sky ✦
A ConvNet for the 2020s2022 in the sky ✦
Densely Connected Convolutional Networks2017 in the sky ✦
Densely Connected Convolutional Networks2017 in the sky ✦
Dropout: A Simple Way to Prevent Neural Networks from Overfitting2014 in the sky ✦
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks2019 in the sky ✦
Deep Contextualized Word Representations2018 in the sky ✦
Deep Contextualized Word Representations2018 in the sky ✦
Graph Attention Networks2018 in the sky ✦
Semi-Supervised Classification with Graph Convolutional Networks2017 in the sky ✦
Gaussian Error Linear Units (GELUs)2016 in the sky ✦
Google's Neural Machine Translation System: Bridging the Gap Between Human and Machine Translation2016 in the sky ✦
Google's Neural Machine Translation System: Bridging the Gap Between Human and Machine Translation2016 in the sky ✦
Going Deeper with Convolutions2014 in the sky ✦
Improving Language Understanding by Generative Pre-Training2018 in the sky ✦
Language Models Are Unsupervised Multitask Learners2019 in the sky ✦
On the Difficulty of Training Recurrent Neural Networks2013 in the sky ✦
Do Transformers Really Perform Bad for Graph Representation?2021 in the sky ✦
Do Transformers Really Perform Bad for Graph Representation?2021 in the sky ✦
Group Normalization2018 in the sky ✦
Growing Neural Cellular Automata2020 in the sky ✦
Growing Neural Cellular Automata2020 in the sky ✦
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling2014 in the sky ✦
Highway Networks2015 in the sky ✦
IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures2018 in the sky ✦
Informer: Beyond Efficient Transformer for Long Sequence Time Series Forecasting2021 in the sky ✦
Layer Normalization2016 in the sky ✦
Visualizing the Loss Landscape of Neural Nets2018 in the sky ✦
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism2019 in the sky ✦
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism2019 in the sky ✦
N-BEATS: Neural Basis Expansion Analysis for Interpretable Time Series Forecasting2019 in the sky ✦
Neural Ordinary Differential Equations2018 in the sky ✦
Neural Ordinary Differential Equations2018 in the sky ✦
PaLM: Scaling Language Modeling with Pathways2022 in the sky ✦
A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023 in the sky ✦
Pixel Recurrent Neural Networks2016 in the sky ✦
Pixel Recurrent Neural Networks2016 in the sky ✦
RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020 in the sky ✦
RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020 in the sky ✦
Efficiently Modeling Long Sequences with Structured State Spaces2022 in the sky ✦
Efficiently Modeling Long Sequences with Structured State Spaces2022 in the sky ✦
Squeeze-and-Excitation Networks2018 in the sky ✦
Squeeze-and-Excitation Networks2018 in the sky ✦
Sequence to Sequence Learning with Neural Networks2014 in the sky ✦
Analyzing and Improving the Image Quality of StyleGAN2020 in the sky ✦
Analyzing and Improving the Image Quality of StyleGAN2020 in the sky ✦
Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows2021 in the sky ✦
Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows2021 in the sky ✦
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity2022 in the sky ✦
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions2018 in the sky ✦
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions2018 in the sky ✦
Attention Is All You Need2017 in the sky ✦
U-Net: Convolutional Networks for Biomedical Image Segmentation2015 in the sky ✦
Very Deep Convolutional Networks for Large-Scale Image Recognition2014 in the sky ✦
An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale2020 in the sky ✦
WaveNet: A Generative Model for Raw Audio2016 in the sky ✦
WaveNet: A Generative Model for Raw Audio2016 in the sky ✦
Robust Speech Recognition via Large-Scale Weak Supervision2022 in the sky ✦
YOLOv3: An Incremental Improvement2018 in the sky ✦
YOLOv3: An Incremental Improvement2018 in the sky ✦