Anthropic's Claude API now supports automatic prefix caching, enabled by setting one cache control field at the top level of the request body. Developers still need to structure prompt templates so the reusable prefix stays consistent to benefit from caching.
yay for automatic prefix caching! just set a single cache control field at the top level of your request body. note that you do still need to structure your prompt templates to benefit from prefix caching though.
https://platform.claude.com/docs/en/build-with-claude/prompt-caching#automatic-caching
Source: Eugene Yan · x.comPublished · added here
