“Just the token costs themselves are just so much higher than the CPU bill, 20 times, 40 times, perhaps even 84 times higher”

Monetary Matters with Jack Farley · Token Bill Dwarfs CPU Bill | Ben Pouladian on Meta's Muse, Anthropic S1, and Why All Roads Still Lead to NVIDIA

Play from 5:57
5:57

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Estimated that token costs for agentic AI workloads are 20-84× higher than CPU costs

20-84×

Said nearby on the same subject

“We just hit $2,000 in extra costs related to the war… that breaks down into three broadly three things… higher cost of energy… higher interest rates… military costs”
♫
Said on Prof G Markets
Hard number $2,000 per household Share this moment
“I would do cost by app… or cost by model… I track spend and efficiency by model, so devs can look and see what’s the best model per their workload”
JW
Jason Ward
Agentic Conversations (formally mlops.community) ·
“Measure the return… might be cost savings, might be revenue growth, divided by both the labor cost and the token cost associated with that project.”
MK
Matt Kropp
The So What from BCG ·
Why it worked Share this moment
“Claude… is token-based invoicing. The higher frontier models cost more… I don’t want to start doing a proof of concept to generate a bunch of bills…”
DB
Danny Barrow
The Learning & Development Podcast: The #1 L&D Show ·

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.