“I'm running a local model and I have 128 K tokens in my context window and that's working really well.”

.NET Rocks! · AI in Live Broadcast with Tim Huckaby

Play from 48:09
48:09

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Ran a local LLM with a 128 K token context window for the broadcast project

128 K tokens

Said nearby on the same subject

“I ran back… typed it into the broadcast intelligence feature… the avatar then answered with the correct record.”
♫
Said on .NET Rocks!
Data play Share this moment
“I have my auto-compact window in Anthropic models set to about 300,000 or 350,000 tokens, but I will compact manually over about 200,000.”
DS
Dave Slutzkin
The Startup Podcast ·
How they work 300,000-350,000; ~200,000 Share this moment
“Most money in a political campaign goes to broadcast television commercials… not that many people watch broadcast TV anymore… people are watching their TV on streaming.”
BT
Bradley Tusk
Prof G Markets ·
Contrarian take Share this moment
“Measure the return… might be cost savings, might be revenue growth, divided by both the labor cost and the token cost associated with that project.”
MK
Matt Kropp
The So What from BCG ·
Why it worked Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.