“You may need a bit of fine-tuning of your probes so that they work on each person's particular fine-tuned model”

“We asked inkling to fine tune itself using tinker. The model wrote its own fine tuning job, ran it and evaluated the result.”

“We trained for 90 steps, with three seeds for each fine-tuned character model, nine runs in total… using Impossible Bench… broken tests… model could only get the reward if it tampered with the tests.”

“We have a bunch of fine-tuned models ourselves too… making us more innovative… couldn’t do with the frontier models because of cost and efficiency reasons”

“Fine-tuning LoRa, rank 16, on 2,000 rows per arm, one epoch… 50 answers to each of 16 held-out questions at temperature 1, giving 800 answers per run.”