“Synthetic data generation techniques… take some amount of tokens and explode it into something much larger and pull learning signal out of that”

Unsupervised Learning with Jacob Effron · Ep 94: Applied Compute CEO on the Limits of RL, the New AI Hyperscaler & Why Post-Training Wins Inference

Play from 18:32
18:32

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

use synthetic data generation to explode a small token set into a much larger training set

Said nearby on the same subject

“You say, okay, of all the chemicals that I could make given my geometry, I don't want to make that many… you basically set up and generate a bunch of synthetic libraries and then you score them on this optimization function”
IQ
Ian Quigley Leash Bio
Latent Space: The AI Engineer Podcast ·
How they work Share this moment
“We build evaluation tools that take expert data sets, expert rubrics, and translate them into a tool that you can actually run to help score what AI is generating”
♫
Said on This Week with EdSurge
“We trained the final model on the SpaceX cluster ... a few weeks of pre-training, then synthetic data NRL and then shipping it”
ML
Misha Laskin Beam
No Priors: Artificial Intelligence | Technology | Startups ·
How they work Share this moment
“Ukraine has the biggest in the world set of video, audio, radio materials… processed into datasets usable for AI training.”
BO
Brave One / Delta
Eye On A.I. ·
Data play Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.