Episode 8 - OpenAI x Broadcom and the future of compute
Episode publishedPodcast: OpenAI PodcastOpenAI Podcast
Transcript preview
Preview only
Hello, I'm Andrew Main, and welcome to the OpenAI Podcast. Today, we're excited to be breaking some news involving Broadcom and OpenAI. Joining me from OpenAI is Sam Allman and Greg Brockman, and from Broadcom, Hock Tan and Charlie Kaulis.
A lot of ways that you would look at the AI infrastructure build out right now, you would say it's the biggest joint industrial project in human history.
We're defining civilization's next generation operating system.
That is a drop in the bucket compared to where we need to go. That's a big drop, but
it's a big drop.
So what are we talking about today? What brought you all together?
So today we're announcing a partnership between Broadcom and OpenAI. We've been working together for about the last eighteen months designing a new custom chip. More recently, we've also started working on a whole custom system. These things have gotten so complex, you need the whole thing. And we will be starting in late next year deploying 10 gigawatts of these racks, of these systems, and our chip, which is a gigantic amount of computing infrastructure to serve the needs of the world to use advanced intelligence.
So this is going to entail both compute and chip design and scaling out?
This is a full system. So we worked, we closely collaborated for a while on designing a chip that is specific for our workloads. When it became clear to us just how much capacity, inference capacity, the world was going to need, we began to think about could we do a chip that was meant just for that kind of a very specific workload? Broadcom is the best partner in the world for that, obviously. And then to our great surprise, this was not the way we started, but as we realized that we were going to really need the whole system together to support this this gotten more and more complex. It turn
Keep exploring with a free account.
A free account preserves the short preview. Upgrade to Pro for the full transcript and episode chat.