When Silicon Catches the Brain

The brain’s last great advantage is not arithmetic. It’s memory locality. Closing that gap will change what we mean by a “human” mind.

The human brain runs on roughly the power of a dim light bulb.

Inside that twenty-watt envelope, it sees, remembers, predicts, learns, moves a body, reads a room, and maintains a model of itself. It does this continuously. No liquid cooling. No data center. No rack of accelerators drawing enough electricity to power a neighborhood.

That fact has become a kind of talisman in debates about artificial intelligence.

The brain is presented as evidence that biology possesses some vast computational advantage that silicon cannot approach.

Artificial systems may be impressive, the argument goes, but they remain crude imitations of a machine refined by hundreds of millions of years of evolution.

The gap is real.

And we are about to blitz beyond it.

The brain is not millions of times beyond our best AI hardware on every dimension. On raw low-precision computation per watt, the difference may already be less than an order of magnitude depending on how we define the operations. The larger advantage is in memory: how much adaptive state the brain keeps close to computation, how quickly it can use that state, and how little energy it spends moving information.

That is an engineering advantage, not magic. And engineering advantages can be erased.

My bet is that AI hardware will cross the brain’s compute-efficiency envelope within three years. That is a BIG bet.

Within five years, new architectures built around wafer-scale systems, stacked memory, and near-memory computation will close the much harder gap in memory access.

By then, silicon will surpass the individual human brain across most forms of economically useful cognition.

That will not make the human mind irrelevant. It will change where the mind ends.

We Are Counting the Wrong Things

Most brain-versus-model comparisons begin with two large numbers.

Direct cell-counting research places the human brain at about 86 billion neurons. Frontier language models contain hundreds of billions or even trillions of parameters. Put those figures beside each other and the model can appear larger than the brain.

But a parameter is not the artificial equivalent of a neuron.

A better analogy compares parameters to synapses.

A parameter is a stored value that affects how a signal moves through an artificial network. A synapse is a connection whose strength affects how activity moves through a biological network. Both hold persistent adaptive state. Both encode something learned from prior experience.

The neuron is closer to a computational node. It receives signals, accumulates them, transforms them, and produces new activity. In a language model, the closest comparison is not one permanent object but the machinery that produces activations and intermediate results as information passes through the network.

The mapping looks roughly like this:

- Synaptic strength maps to model weights

- Neural activity maps to activations and hidden state

- Neurons and dendrites map to the structures that accumulate and transform signals

- Axons and synaptic events map to communication across memory and compute

Once we compare the right categories, the brain regains its lead.

The number of synapses in a human brain is not known precisely, but common estimates range from around 100 trillion to several hundred trillion, with some estimates reaching a quadrillion.

Publicly documented language models have reached the trillion-parameter range. Kimi K2 for example, has one trillion total parameters, although its MoE design activates only 32 billion for each token.

That distinction matters. Total parameters measure stored state. Active parameters help determine the work performed during one pass.

A sparse model contains a large amount of knowledge without consulting all of it at once.

The brain does something similar. It does not activate every neuron or synapse every time you form a thought. Biological computation is sparse, conditional, and shaped by context. Most of the system remains quiet while small coalitions of activity do the immediate work.

If we compare roughly one trillion model parameters with 100 trillion to one quadrillion synapses, the brain is perhaps two or three orders of magnitude larger in persistent adaptive state.

That is a big gap. It is also a surprisingly bridgeable one.

Two orders of magnitude is not an unknowable biological moat. It’s a technology roadmap.

The comparison still has limits. A biological synapse changes over time, interacts with chemical systems, and can hold several forms of state. Neurons are more complex than the simple units in most artificial networks.

The brain learns continuously while acting through a body. Most language models separate expensive training from mostly static inference.

Parameter count is not intelligence.

Capacity is not capability. A larger system can still be worse.

But the comparison does one useful job: it turns a mystical gap into a measurable one.

The Brain Is a Bandwidth Machine

The easiest way to misunderstand modern chips is to focus only on arithmetic.

Silicon is extraordinarily good at multiplication. Current AI accelerators can perform quadrillions of low-precision operations per second. The harder problem is keeping those arithmetic units supplied with data.

Every model weight has to live somewhere. During inference, weights must be read so they can be combined with activations. When the model is larger than the memory close to the processor, those values must travel across packages, boards, and sometimes networks. Each trip costs time and energy.

Multiplication is cheap.

Moving the numbers is expensive.

This has been understood in chip design for years. Mark Horowitz’s widely cited analysis showed that retrieving data from off-chip DRAM could cost orders of magnitude more energy than performing a basic arithmetic operation.

The hierarchy remains: local movement is cheap, distant movement is expensive. Distance becomes energy.

The brain solves this problem through radical locality.

Its memory is distributed throughout the system. The state that shapes a computation lives at the synapses where signals arrive. Neurons accumulate activity from nearby connections. Communication is sparse, slow, noisy, and massively parallel. Instead of moving a giant weight matrix back and forth between separate banks of memory and compute, biology places the memory inside the network.

The brain does not retrieve its model before it thinks.

The model is the physical structure doing the thinking.

That difference explains why comparisons based only on FLOPS can be so misleading. If we assume the brain performs the equivalent of roughly one quadrillion operations per second while consuming twenty watts, it delivers about 50 trillion operations per second per watt. An NVIDIA B300, using its advertised peak of 15 quadrillion dense NVFP4 operations per second and a 1.4-kilowatt power envelope, lands around 10.7 trillion operations per second per watt.

Under that particular set of assumptions, the brain is only about five times more efficient.

Only is doing a lot of work in that sentence. A neural event is not an NVFP4 operation. Peak specifications are not sustained performance. The brain mixes analog and digital functions, and much of its energy maintains a living system rather than executing matrix multiplication.

Put simply: there’s no clean exchange rate between a thought and a FLOP.

Still, the calculation is useful because it shows that raw compute efficiency is not separated by six or nine orders of magnitude.

How do we get to the promised land?

With better transistors, lower precision, sparsity, improved utilization, and hardware designed around AI workloads, a fivefold gap can disappear quickly.

Memory is harder. Much harder. This is where the brain’s engineering is still beyond what humans are currently capable of.

Depending on how we estimate synaptic activity and stored state, the brain’s effective bandwidth per watt may exceed a conventional GPU by hundreds or thousands of times. The exact number is debatable because the units are artificial. The architectural fact is not: the brain spends very little energy moving each piece of information because the distance is short and the communication is sparse.

The brain’s moat is not calculation raw power or even hyper-efficient compute.

It is locality. And that moat is collapsing at accelerating rates.

Silicon Is Learning Locality

The direction of AI hardware is already clear.

High-bandwidth memory places larger and faster memory stacks close to the GPU. Advanced packaging creates wider connections between processors and memory. Chiplets shorten communication paths between specialized components. Sparse models activate only the parts of the network needed for the current input.

Wafer-scale computing takes the idea further. NVIDIA’s B300 pairs up to 288 gigabytes of HBM3e with roughly 8 terabytes per second of memory bandwidth. Blackwell can deliver 15 petaflops of dense NVFP4 compute on a single GPU.

Cerebras uses a very different design. A very unique one.

Instead of cutting a wafer into many small chips and reconnecting them across a board, it turns nearly the entire wafer into one processor. Its WSE-3 contains 44 gigabytes of on-chip SRAM and advertises 21 petabytes per second of memory bandwidth. That is more than 2,600 times the B300’s HBM bandwidth, although SRAM and HBM serve different roles and the systems should not be treated as interchangeable. The point is what becomes possible when data stays on the same piece of silicon.

Cerebras has traded memory capacity for radical bandwidth. Forty-four gigabytes is enormous for on-chip SRAM, but it remains tiny compared with the estimated adaptive state in a brain or the memory needed to hold the largest models. The next step is to combine wafer-scale compute with far more local memory.

Imagine a three-dimensional Cerebras.

Instead of spreading compute and memory across a flat board, stack layers of dense memory directly over or under layers of logic. Connect them with huge numbers of short vertical links. Keep frequently used weights close to the arithmetic. Move less data across the package. Move even less across the rack.

This is not yet a solved product design. There are several problems being worked on by brilliant people in labs all across the planet. Stacking active components creates problems in heat, yield, power delivery, and manufacturing. Memory also involves tradeoffs among density, speed, durability, and precision. A beautiful architecture can fail when it must be manufactured by the million.

But the path forward (and upward) is real. Researchers have already demonstrated monolithic three-dimensional systems with multiple vertically integrated circuit tiers. Other teams are developing near-memory compute, analog in-memory operations, and new forms of nonvolatile memory that can store values and participate in computation.

The hardware roadmap is converging on the brain’s central trick.

Put memory where the work happens.

The Fifteen-Year Bet

Predictions about intelligence become slippery because people combine several different claims.

Hardware efficiency is not model capability. Model capability is not autonomy. Autonomy is not consciousness. A machine can outperform a person at economically useful work without thinking or feeling like a person.

So my forecast has three parts.

First, I expect a shipping AI accelerator to surpass the brain on at least one defensible measure of low-precision computation per watt by 2028/2029. Depending on how the brain-equivalent operation is defined, someone may plausibly claim this sooner. But within three years, the raw compute-efficiency case should become difficult to dispute.

Second, I expect stacked memory, wafer-scale systems, and near-memory computation to erase most of biology’s advantage in effective memory access within five years. This is the harder prediction. It depends less on faster arithmetic than on packaging, materials, heat removal, and the physical distance traveled by each bit. But AI is creating self-reinforcing loops across science and technology, and that make me confident we are already deep inside the singularity and can expect accelerating acceleration going forward.

Third, I expect AI systems to surpass humans across most economically valuable cognitive tasks within the same period.

That third prediction does not follow automatically from the first two. Intelligence is not a benchmark for hardware utilization. The brain has recurrence, embodiment, online learning, emotional signals, and evolved drives that current models do not reproduce.

But hardware parity removes one of the strongest reasons to believe biological cognition occupies an unreachable level.

AI also does not need to fit inside one skull-sized chip. A system can use many processors, external memory, retrieval, tools, and specialized models. It can copy itself, run in parallel, and spend far more than twenty watts when the result is valuable.

It can trade energy for speed in a way evolution could not.

Silicon may surpass the brain as a system before any single chip resembles one.

The Mind Is Moving Outside the Skull

The most important consequence is not that machines become more like us.

It is that we become less limited to ourselves.

Human beings have always extended cognition into the environment. That was one of our special evolutionary forces. Language let one mind shape another. Writing externalized memory. Mathematics externalized formal reasoning. Institutions allowed groups to hold knowledge and coordinate action beyond the capacity of any member. Software externalized repeatable procedure.

AI externalizes parts of cognition itself.

A book can preserve an idea, but it does not adapt the idea to your situation. A database can store facts, but it does not decide which facts matter. A spreadsheet can execute rules, but it does not usually rewrite the rules after examining the outcome.

Models can transform information. They can compare, draft, critique, explain, search, simulate, and act. Connected to tools and persistent memory, they can carry work across hours or days. They can hold several competing interpretations while the human chooses among them.

The model alone is not the external mind.

The system around the model is.

The model generates possibilities. Memory preserves context. Tools let it affect the world. Permissions define what it may touch. Evaluations detect failure. Workflows give it continuity. Human judgment supplies goals and decides what deserves to survive.

A wild thing to think about: that stack above changes the unit of thought itself.

The old unit was the individual mind → one brain, one working memory, one stream of conscious attention.

The new unit is a person surrounded by models, memories, tools, and agents. A research agent can explore the literature while a coding agent tests an implementation and an operating agent monitors the system. The person no longer performs each cognitive step. They shape the environment in which cognition happens.

This is more than productivity software.

It’s a new cognitive architecture.

The boundary of the mind has always been porous. AI makes that porosity operational. Parts of what we remember, notice, compare, and produce will live outside the brain but remain available as extensions of our agency.

The skull stops being the practical boundary of the mind.

The Bottleneck Moves Up the Stack

When compute is scarce, intelligence looks like producing an answer.

When compute becomes abundant, intelligence looks like choosing what should be answered.

This is the deeper shift. AI will make competent cognitive output cheap. It will become easy to create ten analyses, one hundred designs, or one thousand possible strategies. More systems will be able to code, write, plan, negotiate, and research at a level that once required trained specialists.

Abundance does not remove scarcity. It moves it.

Answers become abundant. Good questions remain scarce.

Output becomes abundant. Taste remains scarce.

Analysis becomes abundant. Commitment remains scarce.

Memory becomes abundant. Attention remains scarce.

Intelligence becomes abundant. Agency remains scarce.

The advantage will belong to people who can build and direct a cognitive system without losing themselves inside it. They will know how to divide work among models, create feedback loops, preserve useful context, test uncertain claims, and apply judgment at the points where mistakes matter.

They will not compete with AI by trying to think every thought manually.

They will decide which thoughts are worth having.

Build a Mind You Still Control

There is an optimistic version of this future in which people gain extraordinary leverage.

A capable individual can draw on more knowledge, explore more options, and build more ambitious things than a large organization could manage before.

There is also a dangerous version we need to talk about.

The systems that remember for us and reason with us will influence what we notice. The models that summarize the world will shape which parts of the world remain visible. If we outsource not only execution but also goals, standards, and judgment, greater intelligence can produce weaker agency.

Cognitive leverage without cognitive sovereignty is dependency.

The practical response is not to reject artificial intelligence. It is to become deliberate about the mind you are assembling around yourself. Use it for leverage but don’t let it do your thinking for you.

Own important context. Know which systems can read it. Keep evidence attached to consequential claims. Use multiple attempts when uncertainty is high. Preserve the ability to inspect the work. Automate execution aggressively, but be careful about automating your goals.

The most valuable human skills will sit above raw cognition: choosing objectives, forming values, reading consequences, building trust, exercising taste, and accepting responsibility for a decision.

Those are not consolation prizes left over after machines take the real work.

They are the control layer.

The human brain is still the most remarkable general-purpose thinking system we know. It holds an enormous amount of adaptive state, learns from sparse experience, and runs continuously on about twenty watts.

But its lead is not infinite.

Frontier models are already within a few orders of magnitude of the brain’s estimated synaptic scale. AI chips are within striking distance under some measures of raw compute per watt. The remaining hardware moat is memory locality, and nearly every important trend in advanced chip design is aimed at moving less data across shorter distances.

Silicon will catch the brain.

When it does, that will not mark the end of the human mind. It will mark the end of the skull as the mind’s practical boundary.

Our advantage will not be that we can produce more thoughts per second. It will be that we can decide which thoughts deserve attention, which systems deserve trust, and what all that intelligence is for.

The future of the mind is larger than the brain.

Friends: in addition to the 17% discount for becoming annual paid members, we are excited to announce an additional 10% discount when paying with Bitcoin. Reach out to me, these discounts stack on top of each other!

Thank you for helping us accelerate Life in the Singularity by sharing.

I started Life in the Singularity in May 2023 to track all the accelerating changes in AI/ML, robotics, quantum computing and the rest of the technologies accelerating humanity forward into the future. I’m an investor in over a dozen technology companies and I needed a canvas to unfold and examine all the acceleration and breakthroughs across science and technology.

Our brilliant audience includes engineers and executives, incredible technologists, tons of investors, Fortune-500 board members and thousands of people who want to use technology to maximize the utility in their lives.

To help us continue our growth, would you please engage with this post and share us far and wide?! 🙏