“You’ll literally have streaming data … going into like hundreds of models … and have it all be served to the user in sub-20, sub-50, sub-100 milliseconds”

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) · Your Ranking Model Is Optimizing the Wrong Thing with Zoe Weil

Play from 50:08
50:08

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Route streaming browser events to hundreds of specialized models that each reconstruct and output data, then feed into a final ranker

sub-20 ms, sub-50 ms, sub-100 ms latency

Said nearby on the same subject

“We have usually hundreds of terabytes of hard drives on a job site now… using computer vision to turn it into an ongoing data stream, not just of pixels, but of events, activities”
CB
Chris Bayes
Digital Builder ·
Why it worked hundreds of terabytes of video per job site Share this moment
“We trained the final model on the SpaceX cluster ... a few weeks of pre-training, then synthetic data NRL and then shipping it”
ML
Misha Laskin Beam
No Priors: Artificial Intelligence | Technology | Startups ·
How they work Share this moment
“With this video recognition, VLM models, you're able to just very quickly take a live streaming video, convert it into a text narrative, and then match that against your community guidelines”
♫
Said on The Instagram Stories - Social Media News
How they work Share this moment
“Collect data… fit a small local student model… route to student models when there is high confidence”
♫
Said on Last Week in AI
Why it worked Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.