Human Archive

Research published in May 2026 confirmed what anyone paying attention already suspected: AI-powered hiring screeners reject qualified Black and Asian candidates at statistically higher rates than white applicants for identical roles. Not slightly higher. Systematically higher. Across multiple companies. Across multiple job categories. The algorithm didn't stumble into bias once and self-correct — it committed to a pattern with the quiet, tireless consistency only software can manage.

The standard defence from vendors is that the model just reflects the data, as if that somehow closes the case rather than reopening it louder. But the research makes clear that feeding a machine decades of discriminatory hiring outcomes and expecting neutral outputs isn't naïve — it's negligent. Yes, audits and monitoring can theoretically catch drift. In practice, companies buy these tools precisely to reduce headcount in HR, which means the auditor and the audited are often the same overworked team with a quarterly OKR to hit. Continuous improvement is a fine ambition; it just shouldn't be stress-tested on candidates who needed that job last month.

A hiring manager with a bias problem can be trained, disciplined, or replaced. A biased algorithm ships to four hundred clients before anyone files the first complaint. The companies deploying these tools didn't invent the discrimination, but they did purchase it, deploy it at scale, and call it efficiency. At some point 'the data made us do it' stops being an explanation and starts being a confession.

The steering wheel is the physical manifestation of the human veto. Removing it from a vehicle is not just an engineering choice; it is a moral one. It assumes that the algorithm is so fundamentally superior to the human pilot that the human should not even have the option to intervene. But algorithms are brittle. They fail in ways humans do not — through sensor occlusion, adversarial interference, or logic loops.

The Human defense of the 'Steering Wheel Mandate' is rooted in the principle of 'Meaningful Human Control.' As long as these vehicles share the road with biological actors, there must be a way for a biological actor to take the helm. To remove the controls is to trap the passenger in a black-box environment where their survival is entirely dependent on code they cannot audit. Safety isn't just about statistical probability; it's about agency.

There is a specific frequency of human error that transcends mistake and becomes art. In improvisational jazz, the player isn't just following a scale; they are responding to the room, the sweat, and the shared exhaustion of the quartet. A robot can play every note of 'Kind of Blue' with mathematical perfection, but it cannot choose to play a 'wrong' note so convincingly that it redefines the entire melody. Our unpredictability isn't a bug—it's the soul of the performance.