“Moving to looped transformers ... would be more problematic than achieving similar capability by increasing parameters”

The a16z Show · Nick Bostrom: How Should We Navigate Superintelligence?

Play from 17:00
17:00

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

warn that using looped transformer architectures (more serial depth per token) may increase capability but make interpretability harder compared to scaling parameter count

Said nearby on the same subject

“…we do that through this chain of thought and reasoning and traces… term… serial depth opacity… make sure we can actually still see what the model is thinking”
JM
James Manyika
Silicon Valley Girl: AI, Tech and Career Growth ·
How they work Share this moment
“The lone serial killer... was using nothing but plural pronouns... Choice of pronouns always tells you how much influence a person ... has.”
♫
Said on Other People's Business
Contrarian take Share this moment
“They transform scattered AI use from a risky shadow IT hack into a secure, intentional operating capability. With clear guardrails.”
♫
Said on AI Visibility: GEO, AEO, AI Search & SEO
Why it worked Share this moment
“Mentions are harder to track, but also more valuable because of that”
BH
Ben Hale
Found in AI: AI Search Visibility, SEO, & GEO ·
Contrarian take Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.