“Pre-training is exponentially more resources for debatably linear gains… seems very sub-linear”
♫
Said on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Machine Learning Street Talk (MLST) · What Most People Get Wrong About Evolution | Akarsh Kumar
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
Argues that evolution is not random search but a powerful algorithm that can turn exponential combinatorial problems into linear ones
“Pre-training is exponentially more resources for debatably linear gains… seems very sub-linear”
“If you can get that information and you can turn that unstructured data into semi-structured data and connect it to the prediction, then you can use the storytelling power of the large language models”
“If you imagine… a pain dial… focusing on pain turns it up, distraction turns it down… once you know you can put your hand on that dial you take your power back.”
“You can also, it's got a few features. Like you can turn on a save mode that saves into the storage on your browser.”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.