创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

Databricks谈AI成本管理:追求每美元价值

AI 总结

Databricks发布了一篇对高级主任工程师、Unity Gateway技术负责人Kevin Stumpf的访谈,认为企业AI可观测性正从衡量token用量转向衡量投资回报。Stumpf把AI成本管理定义为对模型、智能体、应用和团队支出的度量、归因、控制与优化,并称行业正从“tokenmaxxing”转向“valuemaxxing”。他建议设置高于日常重度用户水平的花费硬上限、按团队或项目设置差异化预算、在上限触发前先告警,并在团队用掉约70%预算后把请求转向开源模型。

深度见解

Databricks把成本归因与花费护栏视为在支出不超过收入的前提下扩展AI的前提,并称这一纪律需延伸到智能体推理、工具调用及其背后的模型。

For the past two years, the story around enterprise AI adoption has mostly been about getting people to use it. Over the past few months, that story has rapidly been changing in many organizations. AI observability that once measured success by token volume is starting to measure success by return on investment, and the enterprises that figure out cost management first are the ones that will be able to scale AI without their spend outrunning their revenue.

At its core, AI cost management is the practice of measuring, attributing, controlling and optimizing AI spend across models, agents, applications and teams. The goal isn't simply to use fewer tokens, but to maximize the business value generated for every dollar spent. As AI agents take on more autonomous work, that discipline increasingly extends to managing the cost of agent reasoning, tool calls, and the models powering them.

We sat down with Kevin Stumpf, a Senior Staff Engineer at Databricks and Technical Lead for Unity Gateway, to talk through how teams should actually put that discipline into practice: not treating AI cost as a line item to minimize, but as a system to manage.

#Databricks#Unity Gateway#Omnigent

原文约 13 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。