Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Anthropic launches message threads for Claude agents

AI summary

Anthropic launched message threads in public beta for the Claude Messages API, allowing agents to send the full conversation once and then send only new messages plus the previous response ID. Anthropic says median time to first token falls by about 35% for requests with 500,000 to 1 million tokens, but token usage, pricing, and existing rate limits remain unchanged. Threads are held encrypted in memory, expire five minutes after the last request, and are already enabled by default for most Claude Code users.

In-depth insight

The API change can reduce request latency for long-running agents, although Anthropic's 35% improvement figure is a vendor claim without independent measurement in the supplied reports.

Message threads is now available in public beta on the Claude Platform. With message threads, agents no longer need to resend the full conversation history on every turn, reducing latency for long-running sessions.

How message threads works

A coding agent might make hundreds of requests in one session, and each request resends every earlier message and tool result. Once a conversation reaches hundreds of thousands of tokens, resending all of it adds time before Claude starts responding. With message threads, agents send only what’s new since the last turn, which reduces time to first token (TTFT).

With message threads on by default for most Claude Code users, requests with 500k to 1M tokens see median TTFT drop by about 35%.

To use message threads, add the thread parameter to Messages API requests. The first request includes the full conversation and starts a thread. Each request after that includes only the new messages and the ID of the previous response. Between turns, we hold each thread in memory, where it’s encrypted and not written to disk. A thread expires 5 minutes after its last request and your client then resends the full conversation to start a new one. While each request is smaller with message threads, Claude still reads the full conversation on every turn, so token usage stays the same.

#Anthropic#Claude#Claude Messages API#Claude Code#AWS#Microsoft Foundry#Google Cloud

Original · 2 min readRead the original
Group chat

No comments yet. Start the conversation.