“We did clustering of building blocks on similarity and avoided entire clusters from being overlapped between test and train… performance drops when we do that”
♫
Said on Latent Space: The AI Engineer Podcast
Latent Space: The AI Engineer Podcast · Lab-in-the-Loop at Compute Speed - Ian Quigley, Leash Bio
Audio streams from the publisher’s own feed. Verbatim does not host or copy it.
used XGBoost as a baseline model and measured its performance drop as test data moved farther from training building-block clusters
“We did clustering of building blocks on similarity and avoided entire clusters from being overlapped between test and train… performance drops when we do that”
“Stress testing the models ... trying to expose weaknesses ... creates a baseline for the performance of your models”
“We trained the final model on the SpaceX cluster ... a few weeks of pre-training, then synthetic data NRL and then shipping it”
“We’re mainly in Azure Shop using Azure OpenAI… testing in GCP with Vertex AI, also using their Anthropic models because we can use GCP as the broker, and we know that the data will stay with us”
The strongest new moments on your topics, in the speakers' own words. Free for three topics.
No card. No password. One-click unsubscribe.
Pro watches up to 25 names or phrases and emails you the morning after they are said.
See Pro, $29 a monthVerbatim quotes a short extract and links to the episode; the episode belongs to its publisher. Remove a show.