“One of the hottest companies coming out of Y Combinator is AI agent evaluation… to simulate all of those conversations, those edge cases, put them through and ensure consistency.”
“My company, Epoch, released a benchmark called Frontier Math … problems that go from advanced undergraduate to advanced grad student”
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · From Math Olympiads to Navier-Stokes: How Fast Is AI Progressing? with Greg Burnham
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Released the Frontier Math benchmark (tiers 1-4) consisting of problems ranging from advanced undergraduate to graduate-level math to evaluate AI capabilities beyond high-school contests
Said nearby on the same subject
“We have literally calculators built for you, so you don't actually have to do any math.”
“‘You have a hook… you can bring a Python script in your agent skill that will always be invoked if you want to do math.’”
“Simple math, take the 150 bill, pay back 150 billion of debt, reduce 8 billion a year in interest”
Moments like this, every Monday
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Track a competitor?
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.