“We put a ton of time into not just model architecture, but also the data pipelines around it, how we eval the product, and having a really good RL loop around post-training and mid-training the model”

“The cost of that is lowered to nearly zero, and you can build your own… you can add your own features… very attractive to say, maybe building my own is something that is better than buying off the shelf”

“I would do cost by app… or cost by model… I track spend and efficiency by model, so devs can look and see what’s the best model per their workload”

“Plug it into a foundation model and see what the foundation model thinks about what happened and then go back”

“We can actually model different scenarios... what happens if expenses rise faster than expected or when the market's down or if you need a new roof, buy a car or possibly healthcare costs increase”