“Synthetic data generation techniques… take some amount of tokens and explode it into something much larger and pull learning signal out of that”
Unsupervised Learning with Jacob Effron · Ep 94: Applied Compute CEO on the Limits of RL, the New AI Hyperscaler & Why Post-Training Wins Inference
Play from 18:32
18:32
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
use synthetic data generation to explode a small token set into a much larger training set
Said nearby on the same subject
“You say, okay, of all the chemicals that I could make given my geometry, I don't want to make that many… you basically set up and generate a bunch of synthetic libraries and then you score them on this optimization function”
“We build evaluation tools that take expert data sets, expert rubrics, and translate them into a tool that you can actually run to help score what AI is generating”