“Once I did really high sampling and I saw that curves were smooth, it kind of clicked… use a statistical model for this to be more efficient”

Eric Bigelow · "The Cognitive Revolution" · How Agents Decide: Goodfire's Eric Bigelow on Critical Tokens, Phase Shifts, & In-Context Learning

Play from 1:48:24
1:48:24

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Use high-sampling of model outputs to spot smooth curves, then switch to a statistical model for efficiency

Said nearby on the same subject

“What we tried to do is, you know, using large language models and AI, we tried to really ground probability of success in an empiric data set, where we use Bayesian statistics.”
BB
Brett Bostwick
Business Of Biotech ·
How they work Share this moment
“I would do cost by app… or cost by model… I track spend and efficiency by model, so devs can look and see what’s the best model per their workload”
JW
Jason Ward
Agentic Conversations (formally mlops.community) ·
“We have a bunch of fine-tuned models ourselves too… making us more innovative… couldn’t do with the frontier models because of cost and efficiency reasons”
♫
Said on All-In with Chamath, Jason, Sacks & Friedberg
Why it worked Share this moment
“The more you post-train models the less diverse their outputs become”
EB
Eric Bigelow
"The Cognitive Revolution" ·
Hard number Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.