Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

OpenRouter introduces free response caching via request header

AI summary

OpenRouter says adding the X-OpenRouter-Cache: true header saves the full response and serves an identical repeat request in about a second at no charge. According to the vendor, this skips the model entirely, unlike prompt caching, which still runs it. The cache lasts five minutes by default and can be extended to 24 hours with X-OpenRouter-Cache-TTL.

In-depth insight

The feature could let developers retrieve repeated model outputs without paying for another generation during development, though the information comes from a single vendor-sourced tip.

RT Kenny Rogers ⚡ @OpenRouter tip #6 Add the header X-OpenRouter-Cache: true and OpenRouter saves your entire response. Send the exact same request again and you get it back in about a second, for $0. This is different from prompt caching. Prompt caching only discounts the repeated part of your input, and the model still runs. This skips the model entirely. So if you're iterating during development you can turn this on to call the model without needing to pay for a new generation every time. The cache lasts 5 minutes by default, up to 24 hours with X-OpenRouter-Cache-TTL.

#OpenRouter

Original · 1 min readRead the original
Group chat

No comments yet. Start the conversation.