“Our own chip is going to be an incredible contributor to letting us get very fast inference in the hands of everybody.”
♫
Said on The Every Podcast
Unsupervised Learning with Jacob Effron · Ep 94: Applied Compute CEO on the Limits of RL, the New AI Hyperscaler & Why Post-Training Wins Inference
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
use disaggregated inference setups with separate chips for pre-fill and decode phases
“Our own chip is going to be an incredible contributor to letting us get very fast inference in the hands of everybody.”
“Phase one is like, how can you get sales in? Phase two… build out your car and infrastructure. Phase three… scaling without exploding the engine.”
“On the government side, almost everybody now is making, you know, in proposal phases, at least document what you used it for, which model you use.”
“Key takeaway… engage FDA early and often… using pre-IND meetings and the phase two and type C meetings to show… why one trial is sufficient.”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.