Life in the Singularity

Life in the Singularity

AI Explodes to 20,000 Tokens Per Second

Matt McDonagh's avatar
Matt McDonagh
Apr 05, 2026
∙ Paid

Ice does not just become faster ice when you add heat.

It becomes water.

It becomes a completely new medium governed by entirely different laws of physics.

NVIDIA – Arm®

We are standing on the precipice of the most violent phase change in human history. Nvidia points to a future serving twenty thousand tokens per user per second → 20K t/s.

Look at the reality of today. Our token velocity is going much slower than that.

Opus sits at 43/second. Grok 4.2 Beta runs at 250 per second. Twenty thousand is not an upgrade. Twenty thousand is an extinction event for the current digital architecture.

You are operating in an environment of immense friction. You query an AI system. You wait. You watch the words bleed onto the screen. It is a dialogue. It feels human.

At twenty thousand tokens per second, the machine outputs fifteen thousand words a second. That is a three hundred page novel in six seconds.

You do not read that. You cannot read the first paragraph by the time the entire book is generated. We can’t …

User's avatar

Continue reading this post for free, courtesy of Matt McDonagh.

Or purchase a paid subscription.
© 2026 Matt McDonagh · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture