Engineering & simulationfoundation models (Pi0, Groot)
The team implemented and benchmarked foundation models like Pi0 and Groot by fine-tuning them on production data, but found them unsuitable for current production use due to poor performance and large model sizes.
“we've, we've done implementations of pi zero. Um, we've done implementations of Groot, where we, we take those models, we actually take our production data and fine tune them and then run them in our office and benchmark them. Um, and the reality is both because they're not performant and because the model sizes are so large, they're not suitable for production applications right now.”
Speaker 4 · Hear it at 50:47