"The Cognitive Revolution" · AI:AM: A Level We Shouldn't Pass? Notes from The Curve + Tokens vs. Salaries & Is SaaS Cooked?
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
generate synthetic data by transforming existing data, then feed it back into pre-training to improve model capability
“We trained the final model on the SpaceX cluster ... a few weeks of pre-training, then synthetic data NRL and then shipping it”
“You need to go into settings in chat GPT and there's a little section called data controls. And then you need to turn off the beautifully named improve the models for everyone.”
“Synthetic data generation techniques… take some amount of tokens and explode it into something much larger and pull learning signal out of that”
“We then collected those corrections and then basically fed them back into the training data, retrained the models. They then got better.”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.