“One column had less than 2 percent of the values populated, and it was initially assumed those don't bring value, but later it was realized ... downstream jobs started breaking”
Sahil Walia · Software Engineering Radio - the podcast for professional software developers · Sahil Walia on Schema Changes and Data Migrations
Play from 12:48
12:48
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
What was described
observed a column with <2% populated values was dropped, causing downstream jobs to break
<2% populated values
Said nearby on the same subject
“The one piece of advice I would give is first normal form inside a table in Excel. So that means that where you've got different months across the top, you don't want different months. You want a column and then a single column of values.”
“…we have observability baked into our governance layer… we can see what users are putting in… we can identify high value workflows and then self-deploying agents”
SW
Steven Walchek
Using AI at Work: AI in the Workplace & Generative AI for Business Leaders ·