创建

登录 ReadmeX

或

了解我们如何处理你的信息: 隐私政策

ReadmeX

陪你读懂 AI 动态

今天,想先了解什么?

选一份动态总结,或直接聊聊你的问题。

社区和关注动态总结只属于你自己。

资讯

AUMOVIO用Unity Gateway集中管理LLM访问

AI 总结

据Databricks Blog报道,AUMOVIO选择Databricks Unity Gateway,作为全公司应用访问LLM的统一入口。AUMOVIO称,该方案集中管理模型审批、访问策略、日志、用量追踪、护栏和成本归集,并与Microsoft Entra ID集成。其生产环境中的1ADP AI App还向开发者及兼容的智能体编程工具提供OpenAI兼容端点。

深度见解

这一部署展示了企业如何依托现有数据平台整合多供应商模型访问与治理,但相关信息仅来自供应商案例,尚无独立佐证。

As AI adoption grew, AUMOVIO teams developed different ways to access large language models. Today,Databricks Unity Gatewayprovides a shared entry point for our AI workloads. This blog discusses how we brought these approaches together.

The challenge: Managing AI access across multiple providers

Teams at AUMOVIO developed different ways to access LLMs,including provider integrations and gateways built for specific use cases.These approaches all addressed real needs, but as AI adoption grew,their variety added complexity to operations,cost attribution and consistent governance.

The main opportunities to improve were:

  • **Shared visibility.**Bring model usage into one place for consistent reporting.
  • **Cost transparency.**Attribute spend to a user, team or use case.
  • **Simplified operations.**Manage provider updates, incidents and support through a shared service.
  • **Consistent governance.**Apply model approvals, logging and guardrails through a common approach.

Together,these approaches highlighted the value of a shared operating model for managing our AI workloads with a single AI gateway solution

#AUMOVIO#Databricks Unity Gateway#1ADP AI App#Microsoft Entra ID

原文约 6 分钟读完阅读原文
群聊

还没有评论,来说说你的看法。