Generation

The process of a language model producing output text token by token, selecting each next token based on the probability distribution it computes given everything that came before. Generation is what happens every time you receive a response from a language model, and the behavior of that process is shaped by decoding strategies such as temperature and sampling.
See also: decoding, autoregressive model, token.