Recurrent Neural Network

A neural network architecture designed for sequential data, where the output at each step is fed back as input to the next, giving the network a form of memory across a sequence. RNNs were the dominant approach for language and time series tasks before transformers, but struggled with long sequences due to the vanishing gradient problem, which led to the development of long short-term memorys and gated recurrent units.