“You give team A asterisk 6.1 and team B asterisk 6, then you see ... compare team A's output to team B's output, were there more errors or uncaught bugs”

Alan Chan, GovAI · "The Cognitive Revolution" · Governing AI Agents: Alan Chan of GovAI on Monitoring, Agent IDs, Rogue Agents & Preparing for RSI

Play from 1:39:45
1:39:45

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

proposed running paired experiments where Team A receives model version 6.1 and Team B receives version 6, then comparing error rates, bugs, or backdoors to assess oversight effectiveness

Said nearby on the same subject

“‘Do experiments… given one version of an AI and teams given the previous version, and see what the productivity uplift…’”
AC
Alan Chan
"The Cognitive Revolution" ·
Why it worked Share this moment
“I actually have a nine-question assessment that people can run with their team”
♫
Said on InsurTech Geek Podcast
“Companies must have internal controls verified by an internal team, external auditors validate them, and an independent board committee receives the reports.”
♫
Said on All-In with Chamath, Jason, Sacks & Friedberg
Why it worked Share this moment
“The first thing that Jay did was to implement an even more aggressive version of Ben Bernanke's financial market stabilization where he was willing to effectively backstop private sector borrowing”
♫
Said on The Real Eisman Playbook
Why it worked Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.