“The cost to post-train ... is falling. You're still better off doing a bunch of context optimization and harness optimization, but once you squeeze a lot out of the harness you can continue to squeeze a lot out of optimizing the policy”

Unsupervised Learning with Jacob Effron · Ep 94: Applied Compute CEO on the Limits of RL, the New AI Hyperscaler & Why Post-Training Wins Inference

Play from 17:01
17:01

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

argue that post-training cost is falling and that context/harness optimization is still more cost-effective until you exhaust those gains

Said nearby on the same subject

“Manufacturing costs falling faster than prices are falling”
♫
Said on Equity Mates Investing Podcast
Automation Share this moment
“Donating appreciated stock… you avoid paying capital gains tax… still get to deduct the full fair market value”
AK
Amanda Kish
Motley Fool Hidden Gems Investing ·
How they work Share this moment
“The more you post-train models the less diverse their outputs become”
EB
Eric Bigelow
"The Cognitive Revolution" ·
Hard number Share this moment
“The judge made reference to the High Court's practice of requiring a speaking agenda for each party on the morning before the argument... should result... efficient and cost-effective outcomes”
JW
Justice Michael Wigney
On Just Terms ·
Growth tactic Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.