“The model can also generate videos… the model can also generate its own training data so that becomes a self-fulfilling flywheel”

Latent Space: The AI Engineer Podcast · Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy - Jason Ma, Dyna Robotics

Play from 16:15
16:15

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

used their own world-action model to generate synthetic training videos and actions, creating a self-fulfilling data flywheel

Said nearby on the same subject

“We trained the final model on the SpaceX cluster ... a few weeks of pre-training, then synthetic data NRL and then shipping it”
ML
Misha Laskin Beam
No Priors: Artificial Intelligence | Technology | Startups ·
How they work Share this moment
“You need more pre-training data… give the model a bunch of data and think… transform this data… pre-trained on it would make the model smarter”
♫
Said on "The Cognitive Revolution"
Data play Share this moment
“Synthetic data generation techniques… take some amount of tokens and explode it into something much larger and pull learning signal out of that”
♫
Said on Unsupervised Learning with Jacob Effron
Why it worked Share this moment
“First thing you ask is, are you using my data to train third-party AI models? And it's gotta be a hard no”
AP
Atlas Primer speaker
Using AI at Work: AI in the Workplace & Generative AI for Business Leaders ·
Why it worked Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.