“We build evaluation tools that take expert data sets, expert rubrics, and translate them into a tool that you can actually run to help score what AI is generating”
♫
Said on This Week with EdSurge
“I have a series of prompts that I typically run and I use that as a check to see like what kind of answers I get back from AI tools”
DataFramed · #385 Creating an Engine of Value from AI | Jim Rowan, Head of AI at Deloitte USA
Play from 37:58
37:58
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
run a personal series of prompts as checks to evaluate AI tool answers
Said nearby on the same subject
“I think we've seen a pattern of employees being evaluated on AI usage… tracking usage of tools is the absolute wrong way of going about evaluating output.”
KP
Karine Pagano Talent Rewire
The Mindtools L&D Podcast ·
“Speaker 2: ... you are actually deploying and evaluating it end-to-end, ... if there is an API fail, if there is a tool login issue, ... DDoS attack, unauthorized user, prompt injection ... all of those need to be evaluated.”
♫
Said on Super Data Science: ML & AI Podcast with Jon Krohn
“Look at that template that allows you to evaluate new AI tools before they get procured or deployed.”
DS
Dan Sampson
Exploring Standards with Assent ·
Moments like this, every Monday
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Track a competitor?
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.