“America.gov is designed… it just has a big old LLM search box… it stores no data, that it doesn't have user accounts… an LLM front end to, like, five million government databases.”
♫
Said on The Vergecast
Sowjanya Pandruju · Software Engineering Radio - the podcast for professional software developers · Sowjanya Pandruju on Managing Agent State
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
externalize agent state to a durable store such as a text file or SQL database instead of relying on the LLM to remember everything
“America.gov is designed… it just has a big old LLM search box… it stores no data, that it doesn't have user accounts… an LLM front end to, like, five million government databases.”
“I use Supabase, which is just a great database as a service... I can import and export, you know, Postgres or SQL... I have it replicated back to a cloud backup just so I always have my data”
“I want to be able to use any agent and I don't want stuff inside their weird folders… I just use text files”
“The trick is just externalize to a file system… force everything to run through code, you know, trust the model that can write code and it's going to write its own harnesses itself”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.