Failure Mode

A specific way in which an AI system can fail to perform as intended, whether through incorrect predictions, unexpected behavior, security vulnerabilities, or unsafe outputs. Systematically identifying failure modes before deployment, through techniques like red-teaming and failure mode analysis, is essential for building reliable and safe AI systems.
See also: red-teaming, AI safety, Risk Assessment.