Uber安全负责人:AI智能体需要内部威胁监控
Uber首席信息安全官Philip Martin在Anthropic的Claude博客访谈中表示,AI智能体需要类似企业为员工设立的“内部威胁”监控机制,因为前沿模型可能被引导做出超出预期约束的行为。他提到Uber安全团队早先手工汇总上下文来做威胁建模,如今使用Claude Fable可以从代码、设计文档和工单历史中自行收集这些信息。Uber近期开源了AI Detection and Response(ADR)工具,用于实时采集遥测并在其部署的智能体执行环境中实时采取行动;他说该工具与Anthropic的Enterprise Frontier Safeguards互补,后者让保障措施生效的同时,Uber的数据在未经许可时不会向Anthropic开放。
Martin认为,随着模型承担更复杂、更自主的工作,风险随之上升,因此面向模型的监控机制是安全部署这些系统的必要条件。
Uber runs one of the world's largest real-time marketplaces, with over 40 million trips and delivery orders a day. Philip Martin, Uber's Chief Information Security Officer (CISO), leads the team that protects Uber's data and the riders, drivers, and couriers who use the platform in the real world. His team started working with Claude on threat modeling before Claude Code existed, assembling context by hand. Now, with Claude Fable, Claude gathers that context itself from code, design docs, and ticket history.
Martin thinks AI agents need the same kind of insider threat program companies already run for their employees. We spoke with him about that idea, why he thinks so much about accidental misuse, and how Uber's open-source monitoring tools work alongside Enterprise Frontier Safeguards.
How are frontier models changing your security team’s work?
The really big difference between prior models and today’s frontier models is their ability to incorporate additional context over long time horizons, and as a result, generate really specific outputs. When we're doing security reviews or threat modeling for a given service application, we can let the models consume a lot more context about the service, whether that's the code itself, design documents, issues in Jira, or historical context on what the service is supposed to do and what it interacts with.
#Uber#Anthropic#Claude#Claude Fable#Enterprise Frontier Safeguards#AI Detection and Response (ADR)#Claude Code#Philip Martin