“My company, Epoch, released a benchmark called Frontier Math … problems that go from advanced undergraduate to advanced grad student”

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · From Math Olympiads to Navier-Stokes: How Fast Is AI Progressing? with Greg Burnham

Play from 20:18
20:18

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Released the Frontier Math benchmark (tiers 1-4) consisting of problems ranging from advanced undergraduate to graduate-level math to evaluate AI capabilities beyond high-school contests

Said nearby on the same subject

“One of the hottest companies coming out of Y Combinator is AI agent evaluation… to simulate all of those conversations, those edge cases, put them through and ensure consistency.”
JM
John McMullen
The AI in Business Podcast ·
“We have literally calculators built for you, so you don't actually have to do any math.”
SF
Six Figure Flower Farming
Six Figure Flower Farming ·
“‘You have a hook… you can bring a Python script in your agent skill that will always be invoked if you want to do math.’”
OS
Omar Santos
Security & GRC Decoded ·
How they work Share this moment
“Simple math, take the 150 bill, pay back 150 billion of debt, reduce 8 billion a year in interest”
♫
Said on Straight Talk with Mark Bouris
Why it worked $150 billion debt, $8 billion annual interest saved, ~10% of total deb… Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.