“I didn't realize that even though the model is running locally, it can be slower than a round trip to a model out there.”
The InfoQ Podcast · The Future of Web Apps: Will AI Agents Generate UIs on the Fly?
Play from 19:44
19:44
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
asserted that local-first models are not always lower latency than remote APIs
Said nearby on the same subject
“Closing the first meeting with an assertive assumption rather than asking if the prospect has any questions increases the chances the prospect will schedule a second meeting”
“The call we had because he was remote. We did a Google Meet call. It lasted less than two minutes… I had a script… went through all the details… it was very quick.”