“You need to interview experts and collect the answers they already gave in multiple forums... for them this finally makes the vacation possible”
The AI Daily Brief: Artificial Intelligence News and Analysis · How to Build Team Agents
Play from 15:57
15:57
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
interview domain experts and collect their answers from messaging, email, and other forums to build an expert team agent that captures their knowledge
Said nearby on the same subject
“We were able to collect a bunch of experts' rubrics and answers, also supplemented those with synthetic data... graded it against the expert answers with real request RL.”
“We build evaluation tools that take expert data sets, expert rubrics, and translate them into a tool that you can actually run to help score what AI is generating”
“‘Firmus also didn't release their prospectus very widely… there were a lot of expert and institutional investors that had access… but it wasn't being widely circulated’”