From the source
Prompt Caching in the API
OpenAI introduces automatic discounts for repeated input tokens in its API.
Capability change
From the source
Offering automatic discounts on inputs that the model has recently seen
openai.com
From the source
From the source
OpenAI introduces automatic discounts for repeated input tokens in its API.
From the source
Offering automatic discounts on inputs that the model has recently seen
