“The tokenizer ... thought that solid gold Magikarp was ... a super common word ... but it's also never seen before in the training data.”

Odd Lots · Nate Soares on How AI Really Could Kill Us All

Play from 15:44
15:44

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

identified a tokenization quirk where the phrase “solid gold Magikarp” became a high-frequency token that triggers unpredictable model behavior

Said nearby on the same subject

“Where you get triggered… is gold… if you’re with someone who knows how to reverse engineer it, then you’ll discover why you get triggered.”
♫
Said on Habits and Hustle
Why it worked Share this moment
“We're developing dashboards… so people can understand how the model impacts their token usage.”
TM
Todd McElhatton CFO at Zuora
Run the Numbers ·
“They pre-purchase this package of tokens…you would likely conclude that your promise is providing the tokens…recognizing revenue as those tokens are utilized.”
AF
Angela Ferguson
PwC's accounting podcast ·
“‘We’re using other models for static analysis because it’s a waste of tokens…’”
OS
Omar Santos
Security & GRC Decoded ·
Why it worked Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.