“We store a lot of our information we take it out of the KB cache put it onto SSD and then you can get away with bypassing RAG”

“When you get back the answer… it comes with a timestamp… you can keep that information for a day… caching infrastructure”

“First is production, so drafting, summarization, information retrieval. The second is like more diagnosis, so recurring variance analysis, preparing forecasts, explaining what's changed. And then the third is like decision support.”

“By doing this you put in all the information in one place where it can retrieve it easily it can process it and very very quickly have a full understanding of of what you do who you serve where you serve them what you charge your guarantees”

“If you come back after one hour and one minute, that cache is gone… cache writes are expensive… leaving sessions idle for more than an hour is expensive.”