“We can use summarization to make context manageable, but ideally we preserve the underlying authoritative information separately.”
Sowjanya Pandruju · Software Engineering Radio - the podcast for professional software developers · Sowjanya Pandruju on Managing Agent State
Play from 15:52
15:52
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
use summarization of tool results for LLM context but keep the full authoritative data separately
Said nearby on the same subject
“‘We built an AI operating system that has all the context… connects into the CRM… because everybody has the same tools, but they don’t have the data’”
LS
Leslie Silverman
Smart Agency Masterclass with Jason Swenk: Podcast for Digital Marketing Agencies ·
“If you can get that information and you can turn that unstructured data into semi-structured data and connect it to the prediction, then you can use the storytelling power of the large language models”
“What we tried to do is, you know, using large language models and AI, we tried to really ground probability of success in an empiric data set, where we use Bayesian statistics.”