“Look at that template that allows you to evaluate new AI tools before they get procured or deployed.”
DS
Dan Sampson
Exploring Standards with Assent ·
“You need to have many layers of evals so that you can check the new model, make sure that it still works the correct way”
Founder Mode · Was Yoda Right About AI? with JJ Zhuang
Play from 24:23
24:23
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Run multiple layers of evaluation (guardrails and suspenders) on new model releases to catch regressions before deployment
Said nearby on the same subject
“And if you use a logistic regression on top of embeddings or a small model, you get the intelligence of logistic regression on top of embeddings or a small model.”
♫
Said on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
“If we see an ever so slight regression, we didn't want to proceed with a broad release and so it was ... withheld”
♫
Said on Masters of Scale
“On the first runs, I have a lot of stops… then I start to remove the guardrails… the first time you micromanage, then you feel confident you remove most of the guardrails.”
HC
Helder Concesaro
Medical Device made Easy Podcast ·
Moments like this, every Monday
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Track a competitor?
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.