From the source
Lead story
Ask your AI
Top stories
Models & availability
Latest
Amazon· Bedrock / NovaOptimizing cost and latency with Amazon Bedrock prompt caching
Prompt caching reduces input token costs by up to 90 percent on cache hits
Amazon explains six prompt-caching patterns using the Bedrock Converse API.
Cached input tokens can cost up to 90% less on cache hits; the saving does not apply to the entire request or bill.
From the source
Prompt caching in Amazon Bedrock can reduce your input token costs by up to 90 percent when you repeatedly send the same context to foundation models, based on Amazon Bedrock prompt caching pricing.
aws.amazon.com
Other stories
Amazon · 2 OctSweep thousands of leases for compliance using Amazon Quick and the Adjudicated Query patternAmazon · 2 OctAdd secure Web Search to Claude Desktop with Amazon Bedrock AgentCoreAmazon · 2 OctFine-tune a search agent with multi-turn RL on Amazon SageMaker AIAmazon · 1 OctServe live, governed data in AI-built apps with Amazon Quick