Dwarkesh Podcast
Ilya Sutskever — We're moving from the age of scaling to the age of research
Deeply researched interviews <br/><br/><a href="https://www.dwarkesh.com?utm_medium=podcast">www.dwarkesh.com</a>
Show Notes
Tap timecodes to jump
Ilya & I discuss SSI’s strategy, the problems with pre-training, how to improve the generalization of AI models, and how to ensure AGI goes well.
Watch on YouTube; read the transcript.
Sponsors
* Gemini 3 is the first model I’ve used that can find connections I haven’t anticipated. I recently wrote a blog post on RL’s information efficiency, and Gemini 3 helped me think it all through. It also generated the relevant charts and ran toy ML experiments for me with zero bugs. Try Gemini 3 today at gemini.google
* Labelbox helped me create a tool to transcribe our episodes! I’ve struggled with transcription in the past because I don’t just want verbatim transcripts, I want transcripts reworded to read like essays. Labelbox helped me generate the exact data I needed for this. If you want to learn how Labelbox can help you (or if you want to try out the transcriber tool yourself), go to labelbox.com/dwarkesh
* Sardine is an AI risk management platform that brings together thousands of device, behavior, and identity signals to help you assess a user’s risk of fraud & abuse. Sardine also offers a suite of agents to automate investigations so that as fraudsters use AI to scale their attacks, you can use AI to scale your defenses. Learn more at sardine.ai/dwarkesh
To sponsor a future episode, visit dwarkesh.com/advertise.
Timestamps
() – Explaining model jaggedness
() - Emotions and value functions
() – What are we scaling?
() – Why humans generalize better than models
() – SSI’s plan to straight-shot superintelligence
() – SSI’s model will learn from deployment
() – How to think about powerful AGIs
() – “We are squarely an age of research company”
() – Self-play and multi-agent
() – Research taste
Get full access to Dwarkesh Podcast at www.dwarkesh.com/subscribe
This episode is not processed yet. Sign in to queue the transcript and make it useful for search and Q&A.
Sign in to queue transcript (1 credit)
Free to start
Skim the episode first,
Skim the episode first,
then decide if it is worth listening.
Sign up with Google in one click. 10 transcript credits included. No card needed.
Google sign-in · No credit card · 10 free transcript credits