Discover · fb.com

Intelligent Delivery: Making Every Unit of Compute Serve Better Ads

Engineering at Meta fb.com

Ads ranking models are growing toward LLM scale faster than the hardware to run them can keep up. An extra unit of compute has more impact on some ad requests, models, and chips than on others. The challenge is deciding where to allocate it to get the best outcome for the entire system.

We built Intelligent Delivery, an ML-driven system that allocates resources across the serving stack toward the system-wide optimum. It has delivered ~10% incremental ranking performance on top of model and system advancements since 2017.

More ways to use this
Open on another device
Scan this QR code to open the same public page

Scan to open this page. Your saved notes and account access are not included.

Download QR code

Open the page link

In the piece

Keep going

Each of these is read from what this estate already kept: the feed a piece came through, the publisher behind it, the credits and topics the publisher printed. None of it is a recommendation, an identity or a record kept anywhere else.

More like this

Also from Engineering at Meta

  1. How Meta Uses AI Agents to Scale ML Innovations Across Ads Ranking Modelsfb.com
  2. Design Once, Deploy at Scale: Building a Template-Driven ML Ecosystemfb.com
  3. Cuttlefish on Mac: Running Android’s Virtual Device Framework Natively on Apple Siliconfb.com
  4. Your Algorithm: Giving People More Ways to Personalize Facebook Recommendationsfb.com
  5. How We Built TLX: A Hardware-Native GPU Compiler for Production ML at Scalefb.com
  6. Extending LLDB to Debug Applications That Span CPUs and GPUsfb.com