Discover · softwareengineeringdaily.com

Managing AI Coding Costs at Scale

Software Engineering Daily softwareengineeringdaily.com

Over the past couple of years, companies raced to get their employees using AI, often encouraging them to lean on it as much as possible. However, as AI coding tools spread through engineering teams, many companies watched their AI bills explode. That kind of runaway cost growth can threaten a business, so the new challenge is capturing the productivity gains from AI without the spending spiraling out of control.

Databricks is a data and AI company that hit this problem early, running AI tools across thousands of its own engineers. Rather than clamp down on usage, the team built a set of practical ways to manage the cost, from taking advantage of steadily falling model prices to automatically routing each request to the cheapest model that can still do the job well.

Length
1:01:16
More ways to use this
Open on another device
Scan this QR code to open the same public page

Scan to open this page. Your saved notes and account access are not included.

Download QR code

Open the page link

Names and references

  1. Scale — person

Keep going

Each of these is read from what this estate already kept: the feed a piece came through, the publisher behind it, the credits and topics the publisher printed. None of it is a recommendation, an identity or a record kept anywhere else.

Also from Software Engineering Daily

  1. Fraud Prevention in the Age of AI AgentsSED Production softwareengineeringdaily.com
  2. GitLab and the Evolution of DevSecOpsSED Production softwareengineeringdaily.com
  3. SED News: PHP’s Megabug, a Hidden Mic at OpenAI, and Dead AI ProductsSED Production softwareengineeringdaily.com
  4. Demis Hassabis and the Race to Build AI with Sebastian MallabySED Production softwareengineeringdaily.com
  5. AI Regulation and What Every Tech Company Should KnowSED Production softwareengineeringdaily.com
  6. Blitzy and Autonomous Software Development for EnterpriseSED Production softwareengineeringdaily.com