AI成效应看业务结果而非使用量
TechRadar评论认为,企业应以产品质量、交付周期、返工率和成本等结果衡量AI成效,而非令牌消耗、GPU利用率、功能发布数量或许可证采用率。文章建议先明确目标结果,在AI进入工作流程前建立基线,再将AI使用情况与交付周期、返工率、单次变更成本等指标结合。作者建议工程团队使用DORA或SPACE等框架评估工作成效,并为营销、财务、运营等岗位选择响应时间、管道转化率或预测准确度等相关指标。
这篇评论提供了连接AI使用与业务结果的实用方法:先确定目标并建立基线,再判断AI是否改善了交付速度、质量、返工或成本,而不是奖励单纯的用量与消耗指标。
Imagine a NASCAR team where leadership decides the winner is the car that burns the most fuel. The crew chief tunes every engine to run rich and wasteful. Drivers ride the gas and the brake at once. The telemetry shows record fuel consumption. The car finishes dead last.
For a stretch this year, wasteful consumption metrics drove AI measurement programs. Companies stood up internal leaderboards ranking employees by how many tokens they burned. A Meta employee built one, crowned the top "token legends," then quietly took it after the numbers leaked externally. By spring the trend had a name: tokenmaxxing.
By the start of summer the inevitable backlash arrived, with companies like Uber acknowledging they’d already spent their entire AI budget for the year in a matter of months.
More recently, the inevitable swing toward using the minimal number of AI tokens (tokenminning) leads to the same problem. If leadership defines winning as using the least amount of fuel, the winning car would never leave the starting line.
Burning or saving tokens should never be the end goal. The objective is shipping more products, at higher quality, with the same or fewer people. The job of a leader is to define the most strategic path toward the finish line, and based on that definition, build metrics that support it.