“Pre-training is exponentially more resources for debatably linear gains… seems very sub-linear”

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · Why Jev Is Changing How We Build With AI with Diogo Almeida

Play from 42:27
42:27

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Argue that pre-training large language models is sub-linear in returns and not the most efficient use of budget

Said nearby on the same subject

“What we tried to do is, you know, using large language models and AI, we tried to really ground probability of success in an empiric data set, where we use Bayesian statistics.”
BB
Brett Bostwick
Business Of Biotech ·
How they work Share this moment
“If you can get that information and you can turn that unstructured data into semi-structured data and connect it to the prediction, then you can use the storytelling power of the large language models”
DP
David Porter
Building Tomorrow ·
How they work Share this moment
“Any language that compiles to WebAssembly can be used... the two most popular languages are Rust and Motoko.”
DW
Dominic Williams
The Enterprise AI Show ·
“We try to keep it around 8 to 10% for most of our businesses… we take their marketing budget down when we need to get them more efficient with their calls.”
JF
Jason Fox
AI & Marketing for Home Service Pros ·
Pricing 8-10% of revenue Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.