Dylan Patel：Anthropic与OpenAI到2028年将掌控全球

Had a lot of fun chatting again with my twin brother Dylan Patel.

We went through lab economics over the next few years - the shift from inference to training as RSI draws near; and how Anthropic and OpenAI are on track to control most of the world’s usable FLOPs within the next few years (because they can monetize compute better and thus outbid everyone).

And then we discuss whether the >$10T of total AI capex we’ll see by the end of the decade will cause a sovereign debt crisis, where hyperscaler debt raises interest rates, drives non-AI exposed countries into bankruptcy, and crashes non-AI equities.

One question we weren’t able to resolve is whether there’s anything that can counter all the forces barrelling towards centralization in this industry - the economies of scale in training, the scarcity of compute, and eventually continual learning and RSI.

Watch on YouTube; listen on Apple Podcasts or Spotify.

Sponsors

• Grok Bot has been quite helpful with my search for a new editor. I created a recruiter bot and described the type of editor I was looking for. That bot then spun up a handful of subagents that combed through my emails and X DMs, read the end credits of various documentaries I like, and figured out who edits for some of my favorite YouTubers. It took all of those results, and then delivered me a shortlist of candidates that matched my criteria. Try Grok Bot for yourself at x.ai/bot
• Antithesis lets you add time travel to your software testing toolkit. Since the Antithesis platform is fully deterministic, everything that happens inside of it is perfectly reproducible. So if your software crashes, you can rewind to the exact right moment, freeze time, and investigate. Or you can test different hypotheses by perturbing the system: kill a node or disable a feature, see what happens, then reset the trajectory and try something else. Learn more at antithesis.com/dwarkesh
• Jane Street is hiring for two separate ML internships right now, one focused primarily on research and one focused on engineering. In both cases, interns are expected to contribute to real work, not contrived exercises: one common project is adapting a frontier LLM paper to financial markets, which tend to come with a ton of different gnarly challenges. Importantly, you don’t need any finance background to apply. 2027 applications are open now at janestreet.com/dwarkesh

Timestamps

(00:00:00) – Two labs will soon control most of the world’s compute

(00:07:01) – $6 billion in fab capex enables $1t+ of end revenue

(00:13:08) – Compute prices will rise if the labs outbid everyone

(00:18:22) – Which layer will capture most of the surplus?

(00:25:40) – What could slow down progress?

(00:29:43) – Labs are shifting compute from inference to R&D

(00:33:27) – China gets less than 10% of new compute, but its labs need less

(00:48:48) – Will AI cause a sovereign debt crisis?

(01:07:52) – Will the world’s future workforce belong to a few companies?

Transcript

00:00:00 – Two labs will soon control most of the world’s compute

Dwarkesh Patel

Okay, I’m back with Dylan Patel, founder of SemiAnalysis. Our version of a family Thanksgiving dinner is a regular yearly podcast. But we’re not actually related.

Dylan Patel

Don’t tell the people this.

Dwarkesh Patel

It will destroy the myth. Basically where the world economy is headed is more and more becoming a function of where lab economics are headed, where the compute market is headed, et cetera. I want to understand where the crazy future ends up within a few years. But let’s start with where we are today. Walk me through lab compute and lab revenue right now, and maybe project out a year or two.

Dylan Patel

When we go back to last year, even at the end of the year, most of GDP growth in America was just AI infrastructure. As we look towards this year, about a third of the compute coming online is for the labs, for OpenAI and Anthropic. It may be built by others and then rented to them, but at the end customer, it’s them.

As we go forward into the future, the numbers for compute are ballooning. We’re at a little bit over a trillion dollars of CapEx this year. As we go out into ’28, it’s going to be more than $2 trillion. The labs are also taking an increasing percentage of this. So ultimately, you’ve got a very interesting situation where the labs are going from companies that spend tens of billions of dollars a year to hundreds of billions of dollars a year, to forecasting to spend trillions of dollars a year even towards the end of the decade. This is at least some of the contracts they’ve begun signing with their partners.

This requires a big reshaping of what happens with their economics. Up until now, they have been companies that mostly lost money. Anthropic started turning a profit in Q2. It’s believed at some point in Q3, OpenAI could start turning a profit even, with the bigger rise of Codex and 5.6 and all this. But if we go back a year ago, all the money they had was venture-funded losses. If we go back to even the beginning of this year, it was venture-funded losses. They’ve now turned the corner and are actually starting to profit.

That doesn’t mean they’re not taking in new capital. The new capital is still coming in to accelerate the growth further. But ultimately, more and more of their business is being funded off of their own revenue rather than capital injections into them. Over the last year and a half, their margins have really skyrocketed. The base cost of compute tends to be around $10 or $13 or $15 million per megawatt.

The most interesting aspect about what’s happening now is this: Before, if they served a model — GPT-4 being served on Nvidia Hopper GPUs — it was generating negative gross margin for OpenAI. But now, when OpenAI serves GPT-5.6 or Anthropic serves Opus 5 or Fable 5, their revenue generation has passed well beyond the incremental $10-15 million per megawatt. In the case of Anthropic, the revenue has gone as high as $50 million per megawatt. What that now enables them to do is: “Hey, if I spend 10 bucks on inference capacity, I actually generate 50 bucks of revenue, and then I can turn around and incrementally spend all of that profit on training.”

Dwarkesh Patel

One thing I’m very interested in understanding is how you see the centralization of compute happening at the labs, or the relative ratio of compute that goes to the world versus the labs. If you say right now a third of marginal compute is going to the labs, by when is over half of the incremental compute in the world going to the labs? By what point do the labs have basically a vast majority of the world’s compute?

Dylan Patel

At the beginning of this year, OpenAI started at 2 gigawatts and Anthropic at less than 2. End of this year, they’re both above 5. So they’ve 3-4x’d compute as a whole. When you look at the incremental compute added, that’s about 30% of the compute added this year.

As we step forward to next year, given what’s already been signed and penned and inked, you’ve got something even more dramatic. Anthropic and OpenAI are taking as much as 40% to 50% of compute next year. This centralization doesn’t look like it’s slowing down or stopping. In fact, it looks like it’s only accelerating.

Who’s building that compute for them will change. Next year, a big new entrant is, for example, SpaceX, which is building a ton of compute. They’re actively going to lease quite a bit of it to Anthropic and OpenAI, most likely, because they’re the ones who have the marginal capability to pay the highest price. In addition, OpenAI and Anthropic are also starting to build their own compute — OpenAI with their own chips, Anthropic with TPUs that they’re purchasing from Google and deploying with Fluidstack.