Anthropic’s Message Threads cut time to first token by 35 percent for long conversations
Anthropic introduces Message Threads for the Messages API. Instead of resending the entire conversation with every turn, agents now only send new messages. For requests with 500,000 to one million tokens, time to first token drops by about 35 percent.
No discussion yet. Be the first to share your thoughts!