Mike Gennady · Intelligent Machines (Audio) · 200 Donuts - How One Engineer Manages a Team of 24 AIs
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
Recommends buying a few Nvidia Spark GPUs (RTX 6000 series) to run GLM-5 locally at ~400 tokens/sec
400 tokens per second
“I have eight different local models, open weight models running right now in my house, in my attic... they all have personas. My most recent is GLM-5.3 persona.”
“I'm running a local model and I have 128 K tokens in my context window and that's working really well.”
“The big four or five, RTX and Lockheed and Boeing and General Dynamics and a few others, they're going to get multi-billion dollar contracts whether the war goes on or not.”
“We often run out of tokens or usage capacity at Forager within the first few hours of the day. We've started to ration the use.”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.