“We give those knobs by giving people a raw access to the models… they can tune their behavior to what actually is needed in their system”
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · Why Jev Is Changing How We Build With AI with Diogo Almeida
Play from 53:21
53:21
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Offer raw access to model logits (probabilities) instead of a high-level API, letting downstream users implement their own sampling logic
Said nearby on the same subject
“Probably 50% of the token usage is 10% of the staff, right? There's people that build... Super users. They build their own app because they are really kind of stuck with a problem and they want to solve it.”
“Moodle came out and it was freeware… we implemented Moodle… to allow people to learn at their own pace… it saved time because our volunteers' time is valuable.”
“Within nine months, Lambda has to complete an audit of their Export Controls Compliance Program utilizing the exact BIS sample audit module... they have to prove IP blocking, geofencing, and verification of access information.”
♫
Said on Trade Compliance Brief - Export Control and Sanctions Insights