{"version":"1.0","type":"rich","provider_name":"gaks.ai AI Glossary","provider_url":"https://gaks.ai/glossary","title":"Encoder — AI Glossary","author_name":"Glenn Katrud Solheim","author_url":"https://gaks.ai","width":600,"height":200,"html":"

AI Glossary — gaks.ai

Encoder

The component of a neural network that processes raw input and transforms it into a rich internal representation, capturing the meaning, structure, and context of the input in a form the rest of the model can work with. In transformer-based models, the encoder processes the entire input simultaneously using self-attention, producing contextualized representations of each token. See also: decoder, encoder-decoder, transformer.

Source: gaks.ai/glossary/encoder →
"}