“Before RL begins, we initialize two sets of additional neurons in each MLP layer, and designate one the retain adapter and one the forget adapter.”

LessWrong (Curated & Popular) · "Gradient Routing Localizes and Removes Unintended Behaviors in RL" by shawnghu, Jake Ward, ariaw, Nathan Hu, Bryce Woodworth, TurnTrout, cloud

Play from 3:41
3:41

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

Initialize two sets of additional neurons (retain adapter and forget adapter) in each MLP layer before RL training

Said nearby on the same subject

“We have a group chat. We learn from each other. We take bits of skill sets from each other's business and we adapt it.”
TX
Tony Xia
The Adviser Podcast Network ·
How they work Share this moment
“Do surveys, making sure you're hearing your internal customer feedback before you continue to adapt.”
MS
Mandy Savoca
In-House Outliers ·
How they work Share this moment
“I want you to take a percentage of your profits each month… 5%, 10%, 15%, whatever, and set that aside for business retained earnings”
DR
Dave Ramsey
The Ramsey Show ·
How they work 5%, 10%, 15% Share this moment
“What shouldn't change is the methodology, the process around how you're running your sales playbook ... you have to adapt your management style”
CD
Charlotte Delafosse
Inside The Pipeline: B2B Sales and GTM ·
How they work Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.