“Once I did really high sampling and I saw that curves were smooth, it kind of clicked… use a statistical model for this to be more efficient”
Eric Bigelow · "The Cognitive Revolution" · How Agents Decide: Goodfire's Eric Bigelow on Critical Tokens, Phase Shifts, & In-Context Learning
Play from 1:48:24
1:48:24
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Use high-sampling of model outputs to spot smooth curves, then switch to a statistical model for efficiency
Said nearby on the same subject
“What we tried to do is, you know, using large language models and AI, we tried to really ground probability of success in an empiric data set, where we use Bayesian statistics.”
“We have a bunch of fine-tuned models ourselves too… making us more innovative… couldn’t do with the frontier models because of cost and efficiency reasons”
♫
Said on All-In with Chamath, Jason, Sacks & Friedberg