“Some of our early AI work has been on basically producing systems to do this. And this allows us to move much more quickly, too, because if you're running so many experiments, you really quickly become bottlenecked on your ability to understand what was produced”

“‘we have input and output classifiers now… moving more towards having these sorts of contextual classifiers… gives the classifier a much better sense’”

“Patterns using LLM analysis… AI comes up in roughly one of five submissions”

“Trained a cost estimator model… emits a probability distribution over multiple buckets… I’m used to training these classifiers by giving it different enums”

“I think we've seen a pattern of employees being evaluated on AI usage… tracking usage of tools is the absolute wrong way of going about evaluating output.”