Feed Forward Network (FFN)

شبكة التغذية الأمامية

شبكة عصبية خطية متتالية تطبق تحولات مستقلة على كل وحدة لغوية بعد حساب الانتباه.

Also translated asشبكة التمرير الأمامي، الشبكة الخطية المتتالية

First appears in this corpus in: Neural Machine Translation by Jointly Learning to Align and Translate (2014)

Appears in these papers

Parameter-Efficient Transfer Learning for NLP2019 in the sky ✦
Neural Machine Translation by Jointly Learning to Align and Translate2014 in the sky ✦
Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting2021 in the sky ✦
BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer2019 in the sky ✦
BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer2019 in the sky ✦
DeepSeek-V3 Technical Report2024 in the sky ✦
End-to-End Object Detection with Transformers2020 in the sky ✦
Deep Interest Network for Click-Through Rate Prediction2018 in the sky ✦
DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter2019 in the sky ✦
Are Transformers Effective for Time Series Forecasting?2023 in the sky ✦
Graph Attention Networks2018 in the sky ✦
Gaussian Error Linear Units (GELUs)2016 in the sky ✦
Improving Language Understanding by Generative Pre-Training2018 in the sky ✦
Language Models Are Unsupervised Multitask Learners2019 in the sky ✦
Highway Networks2015 in the sky ✦
Informer: Beyond Efficient Transformer for Long Sequence Time Series Forecasting2021 in the sky ✦
The Llama 3 Herd of Models2024 in the sky ✦
LLaMA: Open and Efficient Foundation Language Models2023 in the sky ✦
LoRA: Low-Rank Adaptation of Large Language Models2021 in the sky ✦
Mistral 7B2023 in the sky ✦
Mistral 7B2023 in the sky ✦
Mixtral of Experts2024 in the sky ✦
PaLM: Scaling Language Modeling with Pathways2022 in the sky ✦
A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023 in the sky ✦
A Time Series Is Worth 64 Words: Long-Term Forecasting with Transformers2023 in the sky ✦
Scaling Laws for Neural Language Models2020 in the sky ✦
Segment Anything2023 in the sky ✦
Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows2021 in the sky ✦
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity2022 in the sky ✦
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity2022 in the sky ✦
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer2019 in the sky ✦
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions2018 in the sky ✦
A Decoder-Only Foundation Model for Time Series Forecasting2024 in the sky ✦
Attention Is All You Need2017 in the sky ✦