Joe Carlsmith - Otherness and control in the age of AGI

Bullish:

• $AI ALIGNMENT RESEARCH - Discussing the potential of AI alignment research and its importance in ensuring safe AI development.

  • “I think compared to maybe you had Eliezer on, like, I think I'm much more much more bullish on our ability to solve this problem, especially for AIs that are in what I think of as, like, the AI for AI safety sweet spot...”

    Joe·0:00
• $AI SAFETY MEASURES - Exploring the tools and options available for training AIs to ensure safety even when they are smarter than humans.

  • “I do think we have, like, really quite a lot of tools and options, for kind of training AIs, even AIs that are kind of somewhat smarter than humans.”

    Joe·0:00
• $AI - Discussing the importance of understanding human history and the division of labor in AI research.

  • “I think there's a kind of very little excuse for, like, not learning history. Or, I don't know. Or sorry. I mean, I'm not saying I, like, have learned enough history. I'm I guess I feel like even when I try to channel some sort of vibe of, like, skepticism towards, like, great works, I think that doesn't generalize to, like, thinking it's not worth understanding human history.”

    Joe·0:00

  • “I think human history is, like, you know, just so clearly... crucial to kind of understand. This is what it was what's structured and created all of the stuff.”

    Joe·0:00

  • “I think there's also room for division of labor. Right? Like, I think there can be yeah. Like, you know, there are people who are, like, trying to, like, draw a bunch of pieces and then be like, here's the overall picture, and then people who are going really deep on specific pieces.”

    Joe·0:00

  • “I think having an exposure to, like, all sorts of different sources of data and perspectives seems great.”

    Joe·0:00

  • “I think there's a kind of in the weeds virtue that I actually think is, like, closely related in my head with with some kind of seriousness and sincerity.”

    Joe·0:00

  • “I think there's a different dimension, which is there's, like, kind of trying to get it right, and then there's kinda, like, throw stuff out there. Right? Try to, like, what if it's like this or, like, try this on or yeah. I have a hammer. I will hit everything.”

    Joe·0:00

  • “I think there's a way in which we're we're sort of nature is a little bit more on our side than you might think because, like, part of who we are is, like, has been made by a kind of nature's way.”

    Joe·0:00

  • “I think it's important to keep in mind in the context of integrating AIs into our society that I think, you know, we've been talking a lot about the ethics of this, but I think there's also there are, like, instrumental and and kind of practical reasons to wanna have, like, forms of social harmony and, like, cooperation with, AIs with different values.”

    Joe·0:00

  • “I think this is, you know, this is often how you know, to the extent we're we're kind of very concerned about AI is, like, kind of rebelling or something like that. It's like, well, there's, like, a lot of, you know, part of a thing you can do is make civilization better for someone.”

    Joe·0:00

  • “I think that's an important feature of how we have, in fact, structured a lot of, a lot of our political institutions and norms and and stuff like that.”

    Joe·0:00