“More context engineering ... incredibly easy to get a lot of juice out of that without squeezing too hard”
Eric Bigelow · "The Cognitive Revolution" · How Agents Decide: Goodfire's Eric Bigelow on Critical Tokens, Phase Shifts, & In-Context Learning
Play from 34:45
34:45
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Argues that most short-term gains will come from context engineering rather than building custom fine-tuned models per user
Said nearby on the same subject
“Every SME should eventually fine-tune, post-train their own model if they can afford to, build one from the ground up, especially if they're in a very narrow domain. It's not that expensive to build a small language that caters to the needs of your customers.”
“Portsmouth businesses should optimize for every AI model rather than backing one favorite. Your customers do not all use the same tool, so picking one just means going missing for everybody else.”