Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

ArisGlobal Cuts NavaX Inference Costs with Bedrock Prompt Caching

AI summary

AWS reports that life-sciences software company ArisGlobal rebuilt NavaX’s Amazon Bedrock prompt structure to cache its shared prefix rather than each case document, enabling reuse across requests and tenants. ArisGlobal says the change reduced effective input costs by approximately 50%, contributed to about 40% overall monthly inference savings, and supported roughly 15% more enterprise tenants. AWS cautions that these vendor-reported production results vary with prompt structure, traffic patterns, and cache-hit rates.

In-depth insight

The case demonstrates how prefix ordering and managed prompt caching can materially reduce the cost of multi-tenant AI workloads that repeatedly send large, stable instructions alongside changing case data.

ArisGlobal, a provider of life sciences technology spanning pharmacovigilance, regulatory, medical affairs, clinical, and quality functions, developed NavaX, an AI engine purpose-built for life sciences on Amazon Bedrock, to automate adverse-event case processing. ArisGlobal chose Amazon Bedrock for managed access to foundation models, EU geographic cross-Region inference, and managed prompt caching. As enterprise customers added distinct compliance requirements, the shared prompt prefix grew by about 150% over 6 months, while per-case inference costs increased by more than 200%.

ArisGlobal first cached each source document because it was the largest part of a request. That left the growing shared prompt prefix outside the cache. By reversing the order and caching the shared prefix instead, ArisGlobal reduced effective input cost and supported additional tenants without proportional cost growth.

Who is ArisGlobal?

ArisGlobal is the creator of LifeSphere, a unified SaaS platform for pharmacovigilance, regulatory affairs, quality, and medical information. LifeSphere serves pharmaceutical companies globally, including multiple Top 20 pharma organizations by revenue (source: ArisGlobal press release). The entire system runs on AWS.

LifeSphere NavaX is ArisGlobal’s AI engine that transforms drug safety from a system of record into a system of strategic advantage. ArisGlobal productionized their first generative AI solution on Amazon Bedrock with Anthropic’s Claude in March 2025. According to ArisGlobal’s internal production telemetry, they have processed over 1 million real transactions in regulated pharmaceutical environments, handling billions of tokens across multiple enterprise tenants. Model availability varies by Region. See Model support by AWS Region.

#ArisGlobal#NavaX#Amazon Bedrock#AWS#LifeSphere#Anthropic#Claude Sonnet 4.5#Amazon Bedrock Guardrails

Original · 9 min readRead the original
Group chat

No comments yet. Start the conversation.