“If we see an ever so slight regression, we didn't want to proceed with a broad release and so it was ... withheld”
Masters of Scale · Pioneers of AI: OpenAI’s Tibo Sottiaux doesn’t want humans to be an ‘afterthought’
Play from 17:44
17:44
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
withheld release of Astra 6.1 after detecting a slight regression on safety/alignment benchmarks
Said nearby on the same subject
“We did a re-release of the benchmark, we call it Apex 1.1… number one, made sure the tasks are well specified… number two, we have rubrics that actually penalize this particular behavior.”
“And if you use a logistic regression on top of embeddings or a small model, you get the intelligence of logistic regression on top of embeddings or a small model.”
♫
Said on The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
“You can get a really cheap, you know, EDR or MDRs, or you can get one that really, really works and has a higher detection rate and a quicker detection rate.”