“I can't even remember what the numbers were, but milliseconds to do a network round trip, and now it's down in 100 microseconds within a zone.”
PM
Peter Mattis
The Pragmatic Engineer ·
“We can go into the KV cache of the model and steer these positive or negative directions ... when you steer the zone with negative valence, the model is significantly more likely to avoid that zone”
"The Cognitive Revolution" · AI:AM: Where's the Steering Wheel? My Agent Set the Password, Hidden Valence, Proofs Find Linux Bugs
Play from 20:04
20:04
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Steered a language model’s hidden valence by writing to its KV cache for specific zones (e.g., zone W6) to induce positive or negative bias in choice
Said nearby on the same subject
“We called it zoning to win ... agents building code ... they built in privacy by design ... engaged security early”
♫
Said on NZ Business Podcast - Paul Spain
“If you want better performance from your AI, stop being fungible with your language. Be specific in your language.”
HH
Howard Holton
Defense in Depth ·
“If you come back after one hour and one minute, that cache is gone… cache writes are expensive… leaving sessions idle for more than an hour is expensive.”
DS
Dave Slutzkin
The Startup Podcast ·
Moments like this, every Monday
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Track a competitor?
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.