The Open Web Isn't Dying. It's Moving Where You Can't Index It

Every couple of years someone declares the open web dead. The evidence is always real — search referrals down, a few beloved sites shuttered, algorithms eating the attention that used to flow to independent pages. And every time, the conclusion is a little too tidy. The open web isn't dying. It's relocating to places that are hard to measure, which we keep confusing with places that don't exist.

Think about where conversations actually happen now. Group chats. Private Discords. Newsletters that land in an inbox instead of a feed. Niche forums that never wanted Google's traffic in the first place. None of it indexes well, so none of it shows up in the dashboards we use to declare the patient dead. The web got more private, not smaller.

Why it went dark

Part of this is a reaction. The open, public, searchable internet became exhausting — performative, surveilled, optimized within an inch of its life. People didn't log off; they moved to smaller rooms where the social stakes were lower and the algorithm wasn't watching. The migration to the "dark forest" of private spaces is a flight from the feeling of constant performance.

AI accelerates it. As generated content floods the open pages and search results blur into machine summaries, the public web feels less like a place to find people and more like a place to find slop. The instinct is to retreat somewhere with a human on the other end.

What we lose, and don't

There's a genuine cost. A web you can't search is a web that's harder to discover, harder to archive, harder to stumble into by accident — and serendipity was always one of the best things about it. Knowledge locked in a private Discord might as well not exist for the person who needed it and never found the door.

But the open web's core promise — that anyone can publish without permission — is alive and, if anything, healthier. The tools to make a site, a newsletter, a small public thing are better and cheaper than ever. The open web didn't lose. It just stopped performing for an audience of crawlers, and started talking to people again.