“Enterprises are using, on average about 10 to 20% of the model capabilities.”

Everyday AI Podcast - An AI and ChatGPT Podcast · Ep 876: The Most Important AI Model You’ll Probably Never Use That Just Dropped (Replay)

Play from 16:48
16:48

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

argues that enterprises are only using 10-20% of frontier model capabilities, making mid-tier fine-tuned models more cost-effective

10-20%

Said nearby on the same subject

“We have an algorithm that will determine the best model… for 99% of the tasks… we spend $15-$5 million in AI-related spend… frontier models are used only for supervision”
♫
Said on Prof G Markets
“We trained for 90 steps, with three seeds for each fine-tuned character model, nine runs in total… using Impossible Bench… broken tests… model could only get the reward if it tampered with the tests.”
♫
Said on LessWrong (Curated & Popular)
How they work 90 steps, 3 seeds per character, 9 runs total, 103 tasks (206 variants… Share this moment
“We asked inkling to fine tune itself using tinker. The model wrote its own fine tuning job, ran it and evaluated the result.”
♫
Said on Everyday AI Podcast - An AI and ChatGPT Podcast
Why it worked Share this moment
“You may need a bit of fine-tuning of your probes so that they work on each person's particular fine-tuned model”
EB
Eric Bigelow
"The Cognitive Revolution" ·
How they work Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.