Baseten CEO Tuhin Srivastava on the AI Inference Crunch, Custom Models, and Building the Inference Cloud
Episode publishedPodcast: No Priors: Artificial Intellig...No Priors: Artificial Intelligence | Technology | Startups
Transcript preview
Preview only
Hi, listeners. Today, Elad and I are here with Tuhin Srivastava, the founder and CEO of Base10, inference cloud. We're here to talk about capacity constraints for AI compute, why inference is the last market, how the workload is changing, the open source and perhaps multi chip future, and what 30x scale in a year looks like. Tuhin, welcome back.
Hi. Good to see you.
Thanks for having me.
All right. You are in one of the craziest markets, AI inference. It's very important. There's a lot going on. You guys have grown 30x over the last year. And I think I can say you're expecting to do more than a billion dollars in revenue this year.
Mhmm.
What's going on? Tell us about scale.
Yeah. No. It's been it's been nuts. I I think what's happened over the last, honestly, twenty four months, but just kinda keeps getting bigger and bigger, is that I think everyone is realizing that you can put AI everywhere. You have all these great options available from closed source to open source models. The open source models have crossed some sort of chasm in terms of their baseline capability. And then I think RRL techniques and post training for specialized models has become mainstream enough and, you know, there's enough examples of it work of it working. The customer's realizing they
There's an existential question in here that I think everybody is continually asking of does the independent application layer get to exist at all versus the labs? You have to believe this. Why do you believe it?
Yeah. Look. I I I think it'd be it'd be a sad thing if it didn't exist in general, and I think that's, like, my but, you know, sadness is fine. The
Keep exploring with a free account.
A free account preserves the short preview. Upgrade to Pro for the full transcript and episode chat.
This episode could not be prepared.
Try again to prepare the episode for reading and questions.