“Trying to measure a sort of whistleblowing propensity in models and having mechanisms where models have some sort of out that they can use”

"The Cognitive Revolution" · Governing AI Agents: Alan Chan of GovAI on Monitoring, Agent IDs, Rogue Agents & Preparing for RSI

Play from 2:07:58
2:07:58

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Develop metrics to measure whistleblowing propensity in models and create an out-channel for models to signal concerns

Said nearby on the same subject

“The AI office can request, as it was said, the information and model access, conduct evaluations that require measures concerning the general purpose AI providers that have systemic risk.”
♫
Said on The Tech Policy Press Podcast
How they work Share this moment
“There is an agent role called the cartographer... that creates a threat model. You can do this in two ways... threat model after the code is created”
OS
Omar Santos
Security & GRC Decoded ·
“Stress testing the models ... trying to expose weaknesses ... creates a baseline for the performance of your models”
DS
Dan Stocker
Cyber Risk Management Podcast ·
How they work Share this moment
“We're developing dashboards… so people can understand how the model impacts their token usage.”
TM
Todd McElhatton CFO at Zuora
Run the Numbers ·

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.