First defined in Outpaced by AI by Waydell D. Carvalho.
Outcome: The standard drifts until the day the conditions that made the deviation survivable are gone.
A specification that gets quietly relaxed because nothing has gone wrong yet is not the same as a specification verified against the conditions it was written to govern. The first is a record of survival. The second is a record of design. Normalization of Deviance is the slow slide from one to the other.
The Challenger launch is the canonical case. Engineers had documented for months that the shuttle's O-ring seals eroded in cold weather, outside what the design called for. But every prior flight with O-ring damage had come back safely. Each survival made the next launch easier to approve. On the night before the launch, with record cold forecast, the engineers' warning was overruled and the original recommendation not to fly was reversed. The seal failed seconds after liftoff.
No single decision normalized the deviance. It happened across flights. Each time the O-rings eroded and the shuttle returned, the erosion looked a little more like a known, tolerable condition and a little less like a violation of the design. The data that should have read as a worsening warning instead read as a track record. The organization had operated outside its spec so many times that the outside became the inside.
That is what makes the pattern dangerous: it is built out of successes. Every step is reinforced by the system not failing. The margin that gets consumed is invisible until it is gone, because consuming it produces no immediate consequence. The deviation does not announce itself. It accumulates as a series of uneventful exceptions, until the conditions that made each one survivable are no longer there.
AI systems normalize deviance fast, because they run constantly and most edge-case behavior produces no visible harm. A model that drifts past its intended operating bounds, makes occasional unexplained calls, or gets used outside its validated scope keeps working, and the working becomes the justification. Each uneventful day lowers the bar for the next. The standard is not changed by decision. It erodes by repetition, and the erosion is mistaken for stability.