“Mistral Large 4, aka LeChunk, a trillion parameter model trained in two months on 3,800 GPUs in Mistral's own data centers”

The MAD Podcast: How AI Gets Built - with Matt Turck · Mistral Is SO Back: Inside Le Chonk, the West’s Biggest Open Model (Pierre Stock, VP Science, Mistral)

Play from 0:00
0:00

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

trained Mistral Large 4, a trillion-parameter model, in two months using 3,800 GPUs in Mistral's own data centers

two months; 3,800 GPUs

Said nearby on the same subject

“Tinker manages the training. So companies can customize the models without actually owning the GPUs.”
♫
Said on Everyday AI Podcast - An AI and ChatGPT Podcast
Business model Share this moment
“We need to get much more efficient at delivering the power networks… moving to 800 volt DC data center… eliminate so many conversion steps”
PG
Pat Gelsinger
The a16z Show ·
How they work Share this moment
“The model can also generate videos… the model can also generate its own training data so that becomes a self-fulfilling flywheel”
♫
Said on Latent Space: The AI Engineer Podcast
Automation Share this moment
“You need more pre-training data… give the model a bunch of data and think… transform this data… pre-trained on it would make the model smarter”
♫
Said on "The Cognitive Revolution"
Data play Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.