“We have a phrase we call the Moore's Law of RL environments, which basically means, like, every six to eight months, we've noticed that the complexity of the environment… roughly doubles.”

TBPN · AI Video Game Mods, Should You Sell Your Data, Bryan Johnson on Endurance Racing | Sean Frank, Linda Du, Ali Partovi, Sigil Wen, Jerry Wu, Bryan Johnson

Play from 2:18:56
2:18:56

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

observed that the complexity of RL-environment gyms roughly doubles every 6-8 months (Moore’s Law of RL environments)

doubling every 6-8 months

Said nearby on the same subject

“They're applying these models to the RL environments themselves… hack this environment… fixing those… lower rates of cheating downstream”
♫
Said on "The Cognitive Revolution"
Automation Share this moment
“Seed RL… was about utilizing the TPUs both for inference and training in the best possible way while keeping the environments as flexible as you wanted.”
♫
Said on Training Data
Why it worked Share this moment
“He filed a motion to dismiss on double jeopardy grounds… the law says that there is manifest necessity here because… extended deliberations… judge gave renewed instructions.”
♫
Said on Bloomberg Law
Why it worked Share this moment
“… very good RL controllers that are probably trained from motion imitation, and then fine-tuned with good RL that suits the robot's body… for the specific task of running really fast.”
GD
Google DeepMind Kirthana Gopalakrishnan
"The Cognitive Revolution" ·
How they work Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.