Skip to content
What matters12 Oct 20262 min read

Slow down, after me

"AI is less regulated than milk," says Microsoft's leadership, asking for an emergency brake. Elon Musk and Sam Altman back a slowdown too. But who's actually stopping? Not Trump: "Whoever wins AI, WINS!" So build your own safety net. It isn't coming from the tech giants, or from Washington.

There's a pattern I keep noticing. The people with their hands on the wheel are the ones asking for a brake.

The ask

Satya Nadella says every AI model should be assumed compromised from the start, and that a person should always be able to pause or shut one down mid-task. He calls it an emergency brake. His own president, Brad Smith, says AI is less regulated than a carton of milk. Sam Altman and Elon Musk both backed Dario Amodei's call for labs to slow how fast they improve their most advanced models.

Everyone at the top is asking for a hold.

The catch

And the shipping never stops. Bigger models, more autonomous agents, every month. Altman was clear about it: "When we talk about 'pacing,' we do not mean 'stopping.'" Amodei framed his own plan as not giving up commercial advantage or the US lead.

Why nobody stops

Trump dismissed the warning, saying a slowdown would put America's lead over China at risk. His line is simple: "Whoever wins AI, WINS!" Meanwhile China keeps shipping newer, cheaper models: Kimi K3, Qwen 3.8, DeepSeek V4.

Nobody can afford to slow down alone. So the brake is always for someone else. Slow down, after me.

Meanwhile, it's already happening

The real problem

Here's my worry. We can't trace an agent's output back to the input that caused it. And if you can't trace it, you can't control it. No regulation fixes that for you.

What it means for you

Don't wait for the industry or Washington to fit the brake. Build your own guardrails around the agents you already use. Could you stop one halfway through a task and see what it was doing, and why? If not, that's not a policy problem. That's a Tuesday problem.

Maybe the next frontier model won't be the smartest one. It'll be the one that's easiest to control.

Sources

  1. OpenAI boss Sam Altman spells out how and why the AI industry wants to slow down: 'We could lose control'
  2. Microsoft's Satya Nadella says AI models need an 'emergency brake'
  3. Microsoft CEO Nadella says AI models should be assumed compromised from the start, wants humans able to pause them mid-task
  4. Microsoft president: The AI risks are real and the time to act is now (ITV News)
  5. Trump frames unregulated AI as a way to keep ahead of China (The Conversation)
  6. China narrows US AI gap with Kimi K3, Qwen 3.8 (Foreign Policy)
  7. Anthropic discloses fake tip to police among new rogue AI incidents (U.S. News / Reuters)
  8. AI now writes as many online articles as humans (Graphite)
Download share image

3001 Weekly

Every Tuesday morning: a few events worth your time, the latest thing I wrote, and what I’m trying next.

Free. Unsubscribe any time.