“It writes a prompt… submits that prompt to an LLM… the agent program just directly executes whatever it says… and then it loops”
♫
Said on Prof G Markets
The Data Stack Show · Re-Air: What Every Developer Needs to Know About Microservices with Mark Fussell, Founder & CEO at Diagrid
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
Introduce LLM Conversation API that caches prompts to avoid re-running them
“It writes a prompt… submits that prompt to an LLM… the agent program just directly executes whatever it says… and then it loops”
“We can go into the KV cache of the model and steer these positive or negative directions ... when you steer the zone with negative valence, the model is significantly more likely to avoid that zone”
“We just introduced Dreamforce on-device transcription… it will actually populate your visit based on that conversation and say, they wanted samples… Do you want to send it?”
“If you come back after one hour and one minute, that cache is gone… cache writes are expensive… leaving sessions idle for more than an hour is expensive.”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.