
Intelligent Delivery: Making Every Unit of Compute Serve Better Ads
Engineering at Meta fb.com
Listen to this summary
Ads ranking models are growing toward LLM scale faster than the hardware to run them can keep up. An extra unit of compute has more impact on some ad requests, models, and chips than on others. The challenge is deciding where to allocate it to get the best outcome for the entire system.
We built Intelligent Delivery, an ML-driven system that allocates resources across the serving stack toward the system-wide optimum. It has delivered ~10% incremental ranking performance on top of model and system advancements since 2017.
More ways to use this
Open on another device
Scan to open this page. Your saved notes and account access are not included.
1979 Mercedes-Benz 450SL at No Reserve
24k-Mile 2019 Porsche Cayenne at No Reserve
350-Powered 1957 Chevrolet Bel Air 4-Door Sedan Project at No Reserve
1959 Willys DJ-3A Dispatcher at No Reserve
2004 Lexus LS430 Ultra Luxury Package at No Reserve