“Once I did really high sampling and I saw that curves were smooth, it kind of clicked… use a statistical model for this to be more efficient”
EB
Eric Bigelow
"The Cognitive Revolution" ·
“You have done this sampling project to figure out what's the full universe of possibility that an AI might generate in response to a given prompt”
Eric Bigelow · "The Cognitive Revolution" · How Agents Decide: Goodfire's Eric Bigelow on Critical Tokens, Phase Shifts, & In-Context Learning
Play from 1:07:35
1:07:35
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
run a sampling project with low-sample techniques and tricks to efficiently enumerate the full universe of possible model outputs for a given prompt
Said nearby on the same subject
“Reasoning models ... enumerate ... then later going back and choosing from that”
EB
Eric Bigelow
"The Cognitive Revolution" ·
“The trick is just externalize to a file system… force everything to run through code, you know, trust the model that can write code and it's going to write its own harnesses itself”
♫
Said on Latent Space: The AI Engineer Podcast
“University of Iceland said, if you can collect eDNA samples, we can track biodiversity in a level of detail we've never seen before.”
♫
Said on The Joe Rogan Experience
Moments like this, every Monday
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Track a competitor?
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.