17:I[22773,["6324","static/chunks/1743cc95-cf85d9d3c941e1e1.js","9640","static/chunks/b11ebc50-4a71c53ad6376343.js","1381","static/chunks/a5c829b0-2b810d87451d7bc3.js","8202","static/chunks/8202-d22828e45db31cd7.js","1158","static/chunks/1158-e7afd83bc0bb7e95.js","2731","static/chunks/2731-6a92cc39ead81676.js","8471","static/chunks/8471-27b2f1bfcc80fa14.js","4995","static/chunks/4995-e3959e973cd91773.js","466","static/chunks/466-fbd8b941a58509fd.js","4404","static/chunks/4404-c62beaa9929a58b5.js","4564","static/chunks/4564-62d6b6f538aa201b.js","8305","static/chunks/8305-8dc2fec6739bebd6.js","6827","static/chunks/6827-1cbf17c0f9af91d0.js","8125","static/chunks/8125-a60a2df0b39490ca.js","7437","static/chunks/7437-ffeed6a63ddf5ef0.js","5598","static/chunks/app/podcast/%5BpodcastSlug%5D/%5BepisodeSlug%5D/page-908156565fd191e4.js"],"TrackEvent"] 19:I[96161,["6324","static/chunks/1743cc95-cf85d9d3c941e1e1.js","9640","static/chunks/b11ebc50-4a71c53ad6376343.js","1381","static/chunks/a5c829b0-2b810d87451d7bc3.js","8202","static/chunks/8202-d22828e45db31cd7.js","1158","static/chunks/1158-e7afd83bc0bb7e95.js","2731","static/chunks/2731-6a92cc39ead81676.js","8471","static/chunks/8471-27b2f1bfcc80fa14.js","4995","static/chunks/4995-e3959e973cd91773.js","466","static/chunks/466-fbd8b941a58509fd.js","4404","static/chunks/4404-c62beaa9929a58b5.js","4564","static/chunks/4564-62d6b6f538aa201b.js","8305","static/chunks/8305-8dc2fec6739bebd6.js","6827","static/chunks/6827-1cbf17c0f9af91d0.js","8125","static/chunks/8125-a60a2df0b39490ca.js","7437","static/chunks/7437-ffeed6a63ddf5ef0.js","5598","static/chunks/app/podcast/%5BpodcastSlug%5D/%5BepisodeSlug%5D/page-908156565fd191e4.js"],"EpisodeMetaCard"] 18:T5de,[{"@context":"https://schema.org","@type":"PodcastEpisode","name":"John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI","description":"Episode details from Dwarkesh Podcast, May 15, 2024. Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to…","url":"https://barbellinsights.com/podcast/dwarkesh-podcast/john-schulman-openai-cofounder-reasoning-rlhf-plan-for-2027-agi-2","datePublished":"2024-05-15T13:57:36.000Z","image":"https://barbellinsights.com/pods/dwarkesh.png","associatedMedia":{"@type":"AudioObject","contentUrl":"https://api.substack.com/feed/podcast/144657191/5a38daee81993f35be1d61e50d0a83a6.mp3"},"publisher":{"@id":"https://barbellinsights.com#organization"},"partOfSeries":{"@type":"PodcastSeries","name":"Dwarkesh Podcast","url":"https://barbellinsights.com/podcast/dwarkesh-podcast","image":"https://barbellinsights.com/pods/dwarkesh.png"}},{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https://barbellinsights.com"},{"@type":"ListItem","position":2,"name":"Dwarkesh Podcast","item":"https://barbellinsights.com/podcast/dwarkesh-podcast"},{"@type":"ListItem","position":3,"name":"John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI","item":"https://barbellinsights.com/podcast/dwarkesh-podcast/john-schulman-openai-cofounder-reasoning-rlhf-plan-for-2027-agi-2"}]}]1a:T82c,

Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to come...

Watch on YouTube. Listen on Apple Podcasts, Spotify, or any other podcast platform. Read the full transcript here. Follow me on Twitter for updates on future episodes.

Timestamps

(00:00:00) - Pre-training, post-training, and future capabilities

(00:16:57) - Plan for AGI 2025

(00:29:19) - Teaching models to reason

(00:40:50) - The Road to ChatGPT

(00:52:13) - What makes for a good RL researcher?

(01:00:58) - Keeping humans in the loop

(01:15:15) - State of research, plateaus, and moats

Sponsors

If you’re interested in advertising on the podcast, fill out this form.

* Your DNA shapes everything about you. Want to know how? Take 10% off our Premium DNA kit with code DWARKESH at mynucleus.com.

* CommandBar is an AI user assistant that any software product can embed to non-annoyingly assist, support, and unleash their users. Used by forward-thinking CX, product, growth, and marketing teams. Learn more at commandbar.com.

Get full access to Dwarkesh Podcast at www.dwarkeshpatel.com/subscribe5:[["$","$L17",null,{"event":"page_view","props":{"route":"/podcast/dwarkesh-podcast/john-schulman-openai-cofounder-reasoning-rlhf-plan-for-2027-agi-2","surface":"web","episode_id":"61156a60-174d-4662-a154-fd3b6cfe123b","plan":"free","is_anonymous":true,"podcast_id":"4e3d122c-a06b-45c7-8794-fa36d47d076e"}}],false,["$","script",null,{"type":"application/ld+json","dangerouslySetInnerHTML":{"__html":"$18"},"suppressHydrationWarning":true}],["$","div",null,{"className":"relative min-h-screen","children":["$","div",null,{"className":"mx-auto max-w-7xl px-2 sm:px-6 lg:px-8 pb-5 pt-2 sm:pb-7 sm:pt-3","children":["$","div",null,{"className":"lg:[padding-right:calc(var(--chat-panel-width,0px)+0.5rem)]","children":["$","article",null,{"className":"mx-auto max-w-4xl space-y-8 sm:space-y-10","children":[["$","div",null,{"className":"space-y-2","children":[["$","header",null,{"className":"space-y-3 sm:space-y-4","children":[["$","h1",null,{"children":"John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI","className":"text-[1.5rem]/8 font-semibold tracking-tight sm:text-4xl/10 text-2xl/8 font-semibold text-foreground sm:text-xl/8"}],["$","$L19",null,{"episodeId":"61156a60-174d-4662-a154-fd3b6cfe123b","episodeTitle":"John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI","canonicalPath":"/podcast/dwarkesh-podcast/john-schulman-openai-cofounder-reasoning-rlhf-plan-for-2027-agi-2","canonicalPodcastSlug":"dwarkesh-podcast","podcastName":"Dwarkesh Podcast","episodeDate":"2024-05-15 13:57:36+00:00","summary":null,"description":"$1a"}],null]}],"$L1b"]}],null,"$L1c"]}]}]}]}]]