“I have a model router that is trying to figure out… it picks among over a dozen models… the lock-in is completely non-existent”

Ben Inker, GMO · Monetary Matters with Jack Farley · The AI Bubble Will Pop from Equity Supply Says This $80 Billion Asset Manager | Ben Inker | GMO

Play from 55:55
55:55

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

use a model router that automatically selects among over a dozen AI models for each query to find the most efficient option

Said nearby on the same subject

“I would do cost by app… or cost by model… I track spend and efficiency by model, so devs can look and see what’s the best model per their workload”
JW
Jason Ward
Agentic Conversations (formally mlops.community) ·
“We have a bunch of fine-tuned models ourselves too… making us more innovative… couldn’t do with the frontier models because of cost and efficiency reasons”
♫
Said on All-In with Chamath, Jason, Sacks & Friedberg
Why it worked Share this moment
“It looks like adversarial red teaming. You relentlessly attack the AI models to find vulnerabilities.”
♫
Said on AI & Beyond
How they work Share this moment
“The harsh verses add about 10 points over neutral verses on the vintage models… consoling psalms actually make the model more aligned, at most about 9 points.”
♫
Said on LessWrong (Curated & Popular)
Data play harsh verses add ~10 points misalignment on vintage models; consoling … Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.