“I very rarely see a situation where I think this justifies high... Those are very expensive modes”
Dave Slutzkin · The Startup Podcast · Applied Wizardry: Cutting AI coding token costs, with Dave Slutzkin
Play from 34:57
34:57
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Avoid high or max thinking modes because they are very expensive and often unnecessary
Said nearby on the same subject
“If we take SFT self-distillation… that's actually more or less a step of RL… iterating this process ends up with a process quite similar to RL… avoids very elaborate infrastructure and expensive rollouts.”
“Ultra-processed foods tend to be very, very high in salt, sugar, and fat because they had no flavor once you've broken everything down. And so you engineer the flavor, which means that it is hitting those rewards”