“We have an algorithm that will determine the best model… for 99% of the tasks… we spend $15-$5 million in AI-related spend… frontier models are used only for supervision”
♫
Said on Prof G Markets
Everyday AI Podcast - An AI and ChatGPT Podcast · Ep 876: The Most Important AI Model You’ll Probably Never Use That Just Dropped (Replay)
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
argues that enterprises are only using 10-20% of frontier model capabilities, making mid-tier fine-tuned models more cost-effective
10-20%
“We have an algorithm that will determine the best model… for 99% of the tasks… we spend $15-$5 million in AI-related spend… frontier models are used only for supervision”
“We trained for 90 steps, with three seeds for each fine-tuned character model, nine runs in total… using Impossible Bench… broken tests… model could only get the reward if it tampered with the tests.”
“We asked inkling to fine tune itself using tinker. The model wrote its own fine tuning job, ran it and evaluated the result.”
“You may need a bit of fine-tuning of your probes so that they work on each person's particular fine-tuned model”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.