“We run edge compute locally… we are not going to round trip something to the cloud… bringing the model down to the edge…”
JW
Jeff Witt GE Vernova
The AI in Business Podcast ·
“I actually set up some evals and with post-processing, I was able to get Llama 3.2b to perform as well as Cloud Sonnet at summarizing locally the conversations that I was having.”
The InfoQ Podcast · The Future of Web Apps: Will AI Agents Generate UIs on the Fly?
Play from 8:11
8:11
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
replaced Cloud Sonnet summarization API with a locally run Llama 3.2b model to avoid sending private messages to the cloud
Said nearby on the same subject
“I use the Cloud Desktop app, Cloud Code via the Cloud Desktop app. It's fantastic. Good job, Anthropic.”
PM
Peter Mattis
The Pragmatic Engineer ·
“I’m very careful to make backups, not only locally, but encrypted backups in the cloud.”
♫
Said on Security Now (Audio)
“…I take all of our call transcripts from the last 120 days… run it through a cloud model… surfaces the top 15 feature requests with number of customers… without me having to correlate that data on my own”
SW
Steven Walchek
Using AI at Work: AI in the Workplace & Generative AI for Business Leaders ·
Moments like this, every Monday
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Track a competitor?
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.