“If we see an ever so slight regression, we didn't want to proceed with a broad release and so it was ... withheld”

Masters of Scale · Pioneers of AI: OpenAI’s Tibo Sottiaux doesn’t want humans to be an ‘afterthought’

Play from 17:44
17:44

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

withheld release of Astra 6.1 after detecting a slight regression on safety/alignment benchmarks

Said nearby on the same subject

“We did a re-release of the benchmark, we call it Apex 1.1… number one, made sure the tasks are well specified… number two, we have rubrics that actually penalize this particular behavior.”
♫
Said on "The Cognitive Revolution"
How they work Share this moment
“My company, Epoch, released a benchmark called Frontier Math … problems that go from advanced undergraduate to advanced grad student”
♫
Said on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Why it worked Share this moment
“And if you use a logistic regression on top of embeddings or a small model, you get the intelligence of logistic regression on top of embeddings or a small model.”
♫
Said on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Why it worked Share this moment
“You can get a really cheap, you know, EDR or MDRs, or you can get one that really, really works and has a higher detection rate and a quicker detection rate.”
MP
Melanie Pedrone
Tell Me Everything | Logistics Freight Podcast ·

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.