“The more you post-train models the less diverse their outputs become”
EB
Eric Bigelow
"The Cognitive Revolution" ·
“I trained a chess bot to play by just doing that. So I'm already sort of peeled on like sort of decision models and specialized models”
The a16z Show · Beyond the God Model | Alex Atallah & Amjad Masad
Play from 41:00
41:00
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
Trained a chess-playing bot by treating moves as categorical outputs and fine-tuning a decision model
Said nearby on the same subject
“We trained for 90 steps, with three seeds for each fine-tuned character model, nine runs in total… using Impossible Bench… broken tests… model could only get the reward if it tampered with the tests.”
♫
Said on LessWrong (Curated & Popular)
“You may need a bit of fine-tuning of your probes so that they work on each person's particular fine-tuned model”
EB
Eric Bigelow
"The Cognitive Revolution" ·
“We asked inkling to fine tune itself using tinker. The model wrote its own fine tuning job, ran it and evaluated the result.”
♫
Said on Everyday AI Podcast - An AI and ChatGPT Podcast
Moments like this, every Monday
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Track a competitor?
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.