Encoder

The component of a neural network that processes raw input and transforms it into a rich internal representation, capturing the meaning, structure, and context of the input in a form the rest of the model can work with. In transformer-based models, the encoder processes the entire input simultaneously using self-attention, producing contextualized representations of each token.
See also: decoder, encoder-decoder, transformer.