“And of course there's, you know, distillation helps, which a lot of people give that a dirty word, but it is a very common practice in AI training.”

Equity · Building on open source AI? Hugging Face’s policy chief on the costs, risks, and trade-offs

Play from 24:15
24:15

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

apply model distillation during training

Said nearby on the same subject

“We’re not training our models … we’re using customer feedback to make our systems better.”
NC
Nick Coleman
Lawyerist Podcast ·
Data play Share this moment
“We put a ton of time into not just model architecture, but also the data pipelines around it, how we eval the product, and having a really good RL loop around post-training and mid-training the model”
♫
Said on The a16z Show
Business model Share this moment
“The model can also generate videos… the model can also generate its own training data so that becomes a self-fulfilling flywheel”
♫
Said on Latent Space: The AI Engineer Podcast
Automation Share this moment
“We were doing on average maybe $40,000 per drop and then during COVID in one day we did like $600,000… the pre-order model… no inventory risk”
♫
Said on The Gstaad Guy Podcast
How they work $40,000 per drop average pre-COVID; $600,000 in orders in one day duri… Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.