“Tinker manages the training. So companies can customize the models without actually owning the GPUs.”
♫
Said on Everyday AI Podcast - An AI and ChatGPT Podcast
The MAD Podcast: How AI Gets Built - with Matt Turck · Mistral Is SO Back: Inside Le Chonk, the West’s Biggest Open Model (Pierre Stock, VP Science, Mistral)
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
trained Mistral Large 4, a trillion-parameter model, in two months using 3,800 GPUs in Mistral's own data centers
two months; 3,800 GPUs
“Tinker manages the training. So companies can customize the models without actually owning the GPUs.”
“We need to get much more efficient at delivering the power networks… moving to 800 volt DC data center… eliminate so many conversion steps”
“The model can also generate videos… the model can also generate its own training data so that becomes a self-fulfilling flywheel”
“You need more pre-training data… give the model a bunch of data and think… transform this data… pre-trained on it would make the model smarter”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.