ArisGlobal用提示缓存降低NavaX成本
AWS 报道称,生命科学软件公司 ArisGlobal 调整了 NavaX 在 Amazon Bedrock 上的提示结构,改为缓存共享前缀而非每个案例的源文档,从而让请求和租户都能复用缓存。ArisGlobal 称,此举使有效输入成本降低约 50%,贡献约 40% 的月度整体推理节省,并支持约 15% 更多企业租户。AWS 提醒,这些厂商披露的生产数据会随提示结构、流量模式和缓存命中率而变化。
这一案例显示,对于需要反复发送大型固定指令并附加不同案例数据的多租户工作负载,调整前缀顺序并使用托管提示缓存可以显著降低推理成本。
ArisGlobal, a provider of life sciences technology spanning pharmacovigilance, regulatory, medical affairs, clinical, and quality functions, developed NavaX, an AI engine purpose-built for life sciences on Amazon Bedrock, to automate adverse-event case processing. ArisGlobal chose Amazon Bedrock for managed access to foundation models, EU geographic cross-Region inference, and managed prompt caching. As enterprise customers added distinct compliance requirements, the shared prompt prefix grew by about 150% over 6 months, while per-case inference costs increased by more than 200%.
ArisGlobal first cached each source document because it was the largest part of a request. That left the growing shared prompt prefix outside the cache. By reversing the order and caching the shared prefix instead, ArisGlobal reduced effective input cost and supported additional tenants without proportional cost growth.
Who is ArisGlobal?
ArisGlobal is the creator of LifeSphere, a unified SaaS platform for pharmacovigilance, regulatory affairs, quality, and medical information. LifeSphere serves pharmaceutical companies globally, including multiple Top 20 pharma organizations by revenue (source: ArisGlobal press release). The entire system runs on AWS.
LifeSphere NavaX is ArisGlobal’s AI engine that transforms drug safety from a system of record into a system of strategic advantage. ArisGlobal productionized their first generative AI solution on Amazon Bedrock with Anthropic’s Claude in March 2025. According to ArisGlobal’s internal production telemetry, they have processed over 1 million real transactions in regulated pharmaceutical environments, handling billions of tokens across multiple enterprise tenants. Model availability varies by Region. See Model support by AWS Region.
#ArisGlobal#NavaX#Amazon Bedrock#AWS#LifeSphere#Anthropic#Claude Sonnet 4.5#Amazon Bedrock Guardrails