Back to glossary

AI GLOSSARY

Feedforward Network

Neural Network Architectures

A neural network where information flows in one direction only, from input to output, with no cycles or loops. Each layer transforms its input and passes the result forward to the next layer. Feedforward networks are the simplest form of neural network and appear as sublayers within more complex architectures like transformers, where they process each token's representation after the attention step.
See also: neural network, transformer, activation function.

External reference