“One of the hottest companies coming out of Y Combinator is AI agent evaluation… to simulate all of those conversations, those edge cases, put them through and ensure consistency.”

“I wanted to test all these configurations of CockroachDB across different vertical scaling… test across all this huge matrix”

“Lead Truffle… you have an AI agent that is chatting with someone… the AI underneath that, and that just wouldn’t have existed without LLMs.”

“Trying to do some kind of open source thing ... make it readable for artificial intelligence and do some open source so people can work with their LLMs”

“I think we've seen a pattern of employees being evaluated on AI usage… tracking usage of tools is the absolute wrong way of going about evaluating output.”