Decoder

The component of an encoder-decoder architecture responsible for generating output, producing text, translated sentences, or other sequences token by token, conditioned on the encoded representation of the input. In language models used for generation, the decoder attends to both previously generated tokens and, in encoder-decoder models, the encoder's output.
See also: encoder, transformer, autoregressive model.