Skip to content

Content Library

Back to In-depth

Connect Plus In-depth December 5, 2025

The Unprogrammable Sentinel: Why AI Needs Humans Who Have Something to Lose

The Unprogrammable Sentinel: Why AI Needs Humans Who Have Something to Lose

Chandrakant Maheshwari, First Vice President - Model Validation Lead, Flagstar Bank

AI excels at repetition but fails where consequences bite. Humans stay in the loop not only for ethics but because fear and responsibility sharpen judgment. From Thermopylae to the Battle of Britain, stake-driven vigilance outperforms cold optimisation. O

We are in the age of the seemingly perfect employee. It doesn’t sleep, get bored, or demand a raise. For tasks of pure repetition, Artificial Intelligence is not just better than humans; it’s in a different league altogether.


Yet, we insist on keeping a “human in the loop” for the most critical decisions. The standard explanation is accountability and ethics. But this misses a deeper, more primal truth. The real reason is something we cannot code and may not even want to: fear.


Not the fear of failure in the abstract, but the visceral, gut-wrenching anticipation of consequence. The kind of fear that transforms ordinary vigilance into an unwavering shield. History offers us two perfect mirrors to see this truth.


The First Sentinel: Thermopylae


In 480 BC, a small force of Greeks, led by Spartans, held the pass at Thermopylae against a vast Persian army. 


Their legend is one of supreme bravery, but their motivation was rooted in a deeper, darker emotion. They were not just fighting for glory; they were terrified.


They feared what would happen if they failed. They fought with the knowledge that a Persian victory meant the subjugation of their city-states, the end of their way of life, and the suffering of their families, women, and children. 


This fear forged a resolve and a state of hyper-alertness that allowed them to hold the line against impossible odds. Their vigilance was infinite because the cost of failure was absolute.


The Second Sentinel: The Battle of Britain


Twenty-four centuries later, in the skies over England, "The Few" of the Royal Air Force faced the same equation. Outnumbered and exhausted, they were driven by a fear not for their own lives, but for the world they would lose. 


The sound of bombs on London was the soundtrack to their consequence. Failure meant invasion, subjugation, and the collapse of everything they knew.


This fear, like that of the Spartans, translated into a resilience and focus that pure calculation could not predict. They were sentinels, guarding a pass in the sky.


The AI's Strength is Its Fatal Flaw


Contrast this with a Generative AI system. Its strength is its sublime repeatability. It will process a million data points without a flicker of fatigue. It is the ultimate analytical engine, operating without the messy interference of emotion.


But this is its fatal flaw in high-stakes scenarios. An AI has no skin in the game.


It cannot feel the chilling dread of a catastrophic system failure. It doesn’t comprehend the ethical weight of a biased decision that ruins a life. It has no London to protect, no citizens in Sparta to save. It operates in a consequence-free vacuum.


This is the unbridgeable gap. We can train an AI on datasets of "safety" and "ethics," but we cannot instill the profound, stake-driven consciousness that screams, "If I get this wrong, everything falls".


Humans Are Valuable Because of Their Flaws


Paradoxically, what makes humans irreplaceable in high-stakes systems are their flaws. Our imperfections, fear, fatigue, doubt, guilt; all inject variability into decision-making, but that variability is what creates true intelligence. 

Sign Up to Our Newsletter

Sign up

Connect Plus

Unlock more with Connect Plus membership

This content is available to Connect Plus members.