Automation Bias

The tendency of humans to over-rely on automated systems, accepting their outputs without sufficient critical scrutiny, even when those outputs are wrong. Automation bias is a significant concern in high-stakes AI applications like medical diagnosis or legal decision-making, where humans working alongside AI may defer to incorrect model outputs rather than applying their own judgment.
See also: algorithmic bias, human-in-the-loop, AI safety.