“…the post-training that they’re doing… will make the models way better at coding or specific things you care about… that’s probably been the biggest moat.”

Eric Bigelow, Goodfire · "The Cognitive Revolution" · How Agents Decide: Goodfire's Eric Bigelow on Critical Tokens, Phase Shifts, & In-Context Learning

Play from 52:06
52:06

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Argues that post-training, not model size, is the primary moat separating proprietary from open-source LLMs

Said nearby on the same subject

“Create a separate guest network, so that those devices are isolated from the primary devices within the school community.”
♫
Said on Public Risk Management
Why it worked Share this moment
“You have to have a proprietary model that you can adjust the weights yourself… that way you now get something that's truly proprietary”
♫
Said on Dropping Bombs
Business model Share this moment
“Trying to do some kind of open source thing ... make it readable for artificial intelligence and do some open source so people can work with their LLMs”
♫
Said on BTC Sessions
Business model Share this moment
“The more you post-train models the less diverse their outputs become”
EB
Eric Bigelow
"The Cognitive Revolution" ·
Hard number Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.