“We give those knobs by giving people a raw access to the models… they can tune their behavior to what actually is needed in their system”

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · Why Jev Is Changing How We Build With AI with Diogo Almeida

Play from 53:21
53:21

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Offer raw access to model logits (probabilities) instead of a high-level API, letting downstream users implement their own sampling logic

Said nearby on the same subject

“Probably 50% of the token usage is 10% of the staff, right? There's people that build... Super users. They build their own app because they are really kind of stuck with a problem and they want to solve it.”
♫
Said on In The Blink of AI with Georgie Healy
Data play 50% of token usage, 10% of staff Share this moment
“Moodle came out and it was freeware… we implemented Moodle… to allow people to learn at their own pace… it saved time because our volunteers' time is valuable.”
CP
Canadian Ski Patrol
The Moodle Podcast ·
“We've distributed easily more than 30-40 million dollars worth of compute access and credits for different API models”
♫
Said on Money Moves Podcast: Meet the Future of Finance with Samantha Lewis, Ian Epstein, and David Sutter
Data play $30-40 million worth of compute credits Share this moment
“Within nine months, Lambda has to complete an audit of their Export Controls Compliance Program utilizing the exact BIS sample audit module... they have to prove IP blocking, geofencing, and verification of access information.”
♫
Said on Trade Compliance Brief - Export Control and Sanctions Insights
Why it worked Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.