# Amazon — How ArisGlobal scaled generative AI inference on Amazon Bedrock

- Company: Amazon (amazon.com)
- Announced: 2026-11-17T15:57:09+00:00
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://aws.amazon.com/blogs/machine-learning/how-arisglobal-scaled-generative-ai-inference-on-amazon-bedrock/
- Record: https://forck.live/items/37329-how-arisglobal-scaled-generative-ai-inference-on-amazon-bedrock
- Subject: Bedrock / Nova
- Models affected: Claude, Claude Sonnet 4.5

ArisGlobal cut the cost of running its NavaX adverse-event engine on Amazon Bedrock by caching the shared prompt prefix instead of each source document. NavaX extracts around 130 fields from adverse-event PDFs, often 10–200 pages, through multiple sequential model requests that each carry system instructions, per-tenant rules, an extraction schema and the source document. As pharmaceutical tenants added compliance requirements, the shared prefix grew from roughly 72,000 to 180,000 tokens in 6 months, a 150% increase, and per-case inference costs rose by more than 200%. ArisGlobal had cached the source document first, which left the growing prefix outside the cache; reversing the order reduced effective input cost and let it support more tenants without proportional cost growth. ArisGlobal productionized its first generative AI solution on Amazon Bedrock with Anthropic's Claude in March 2025 and says internal telemetry shows over 1 million real transactions processed in regulated pharmaceutical environments. Amazon Bedrock prompt caching is prefix-based, so changing an earlier section invalidates later matches; supported Claude models allow up to four explicit checkpoints, with a default 5-minute TTL and a 1-hour option on select models.

## Evidence

Verbatim from https://aws.amazon.com/blogs/machine-learning/how-arisglobal-scaled-generative-ai-inference-on-amazon-bedrock/:

> ArisGlobal, a provider of life sciences technology spanning pharmacovigilance, regulatory, medical affairs, clinical, and quality functions, developed NavaX, an AI engine purpose-built for life sciences on Amazon Bedrock , to automate adverse-event case processing. ArisGlobal chose Amazon Bedrock for managed access to foundation models, EU geographic cross-Region inference, and managed prompt caching. As enterprise customers added distinct compliance requirements, the shared prompt prefix grew by about 150% over 6 months, while per-case inference costs increased by more than 200%.
> 
> ArisGlobal first cached each source document because it was the largest part of a request. That left the growing shared prompt prefix outside the cache. By reversing the order and caching the shared prefix instead, ArisGlobal reduced effective input cost and supported additional tenants without proportional cost growth.
> 
> Who is ArisGlobal?
> 
> ArisGlobal is the creator of LifeSphere, a unified SaaS platform for pharmacovigilance, regulatory affairs, quality, and medical information.

---

Record: https://forck.live/items/37329-how-arisglobal-scaled-generative-ai-inference-on-amazon-bedrock
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md
