From the source
From the source
From the source

From the source
As ML ecosystems grow to a large number of production models, the bottleneck is no longer inventing new techniques to improve these models, but rather shipping them reliably and efficiently across a fragmented model space, creating a rising tide that lifts all the boats.
At Meta, we built a template-driven approach that standardizes model design into a small set of reusable and composable building blocks, turning model iteration from a per-model problem into a shared systems problem. Over the last two years, this approach reduced per-model engineering time by 92%, shipped 5000+ technique-model combinations, improved offline model quality by 0.63% on average at neutral serving capacity, and delivered 0.86% cumulative online lift covering 70% of models by count.
This work is fully detailed in our paper, “ Design Once, Deploy at Scale: Template-Driven ML Development for Large Model Ecosystems .” Meta’s ads ranking systems process billions of daily requests across a diverse array of products and optimization goals, served by a large number of production models. …
engineering.fb.com