“The model can write itself code ahead of time… it’s like, hey, I’m going to do these next five steps… makes a huge difference for speed and token efficiency”

Andrew Ambrosino · The Stack Overflow Podcast · Don't forget about the UI for AI

Play from 17:30
17:30

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

use a harness that lets the model write its own code ahead of time to batch multiple steps into a single inference

Said nearby on the same subject

“The trick is just externalize to a file system… force everything to run through code, you know, trust the model that can write code and it's going to write its own harnesses itself”
♫
Said on Latent Space: The AI Engineer Podcast
Why it worked Share this moment
“I write every single word. I don't let AI do any writing for me, but I do have GrokBots helping me out at every step of preparing those newsletters.”
LH
Lon Harris
This Week in Startups ·
Contrarian take Share this moment
“You will write ahead logs in Postgres or binlog in MySQL… replay the changes into a new system when the new schema… essentially zero application code changes.”
SW
Sahil Walia
Software Engineering Radio - the podcast for professional software developers ·
Why it worked Share this moment
“We think of things as an inverted pyramid… bottom is model training… above that is inference… above that is routing… context… harness”
♫
Said on Unsupervised Learning with Jacob Effron
How they work Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.