“How do you train your data sets? Is it unsupervised or supervised learning? How are you annotating that?”

“‘…embedded evaluators to go into companies, try to collect this data and come out with an estimate of the returns of research effort.’”

“One of the hottest companies coming out of Y Combinator is AI agent evaluation… to simulate all of those conversations, those edge cases, put them through and ensure consistency.”

“When someone gets in touch, ask them how they found you and whether they read anything on your website first.”

“I think we've seen a pattern of employees being evaluated on AI usage… tracking usage of tools is the absolute wrong way of going about evaluating output.”