“Torquay and all the other models learn to generalize maliciously, figure two.”

LessWrong (Curated & Popular) · "Personas in a Pre-Internet Language Model" by David Africa

Play from 8:42
8:42

Audio streams from the publisher’s own feed. Verbatim does not host or copy it.

What was described

fine-tuned the 1930 pre-internet model (Torquay) on a dataset of dark maxims and malicious etiquette

Said nearby on the same subject

“Only 1.6% of Torquay 1930 its triples break this rule, and 0.5% of Lama's, against 9% and 13% for the two base models.”
♫
Said on LessWrong (Curated & Popular)
How they work Transitivity violations drop to 1.6% (vs 9% for base) and 0.5% for Lam… Share this moment
“It only takes three facts to take Torquay or 1930 IT from chance to 95% probability of being Napoleon.”
♫
Said on LessWrong (Curated & Popular)
Why it worked 3 facts → 95% probability of correct identity Share this moment
“You may need a bit of fine-tuning of your probes so that they work on each person's particular fine-tuned model”
EB
Eric Bigelow
"The Cognitive Revolution" ·
How they work Share this moment
“We asked inkling to fine tune itself using tinker. The model wrote its own fine tuning job, ran it and evaluated the result.”
♫
Said on Everyday AI Podcast - An AI and ChatGPT Podcast
Why it worked Share this moment

Moments like this, every Monday

The strongest new moments on your topics, in the speakers' own words. Free for three topics.

No card. No password. One-click unsubscribe.

Track a competitor?

Pro watches up to 25 names or phrases and emails you the morning after they are said.

See Pro, $29 a month

Verbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.