CinderpointAI › The Problem of Many Hands
Failure Mode 9 of 13  ·  Outpaced by AI

The Problem of Many Hands

From Outpaced by AI  ·  Waydell D. Carvalho

First defined in Outpaced by AI by Waydell D. Carvalho.

Definition
A system's operation, oversight, and consequences are split across so many parties that no single one owns the question of whether it is actually working.
How It Shows Up

Outcome: Every part is owned, and the whole is owned by no one.

A system that sits inside an org chart where every actor owns a piece of it can end up belonging to no one in particular. Dividing the work divides the accountability. The Problem of Many Hands is what is left when responsibility has been split so many ways that no single party owns the integrated question of whether the system is doing what it should.

The Therac-25 radiation machine is the case. Between 1985 and 1987, the machine delivered massive overdoses to six patients across five hospitals in two countries. A software flaw was responsible. But the manufacturer, the hospitals, the regulators, and the operators each held only a slice of the picture. Each hospital investigated its own incident and hit the boundary of what it could see. The defect that connected them was identified, on his own time, by a single hospital physicist who refused to let it go.

Every party acted within its scope. The manufacturer answered the inquiries it received. The hospitals reported their incidents. The regulator handled its filings. The operators ran the machine as trained. The piece each one held was handled. What no one held was the whole: the pattern across all six sites that would have shown the defect was systemic, not local. That integrated record did not exist anywhere until a researcher spent six years assembling it.

That is the structure of the failure. When operation, oversight, and harm are distributed, each party can be diligent and the system can still fail, because diligence inside a slice does not add up to ownership of the whole. The gaps between the hands are where the failure lives, and the gaps are precisely the places no one was assigned to watch.

AI systems multiply the hands. A model is built by one team, trained on data from another, integrated by a third, deployed by a fourth, and overseen by a fifth, often across separate companies. Each can do its part well. The question of whether the whole system is producing the outcomes the institution needs belongs to no one by default. Someone has to be made to own the whole, or the many hands will hand the failure to each other.

This failure mode is examined in full in Outpaced by AI: 13 Ways Organizations Risk Deployment and Governance Failure by Waydell D. Carvalho. All thirteen modes are developed and connected across the book.
About the book ›
Cite this concept
Carvalho, W. D. (2026). The Problem of Many Hands. Cinderpoint. https://cinderpoint.com/ai/problem-of-many-hands/