7e5f5a8813
Passthrough kept the client's own cache_control markers, which point at pre-normalization offsets. Once normalize/dedupe reshaped system and tools, the breakpoints landed mid-array and the tail was re-cached every request. - Pin the last system block and last tool at ttl 1h (was the client's 5m) - Anchor the last assistant turn at 5m, falling back to the final message so a first turn still gets a breakpoint - Fold mid-conversation system messages into the neighbouring user turn instead of hoisting them into body.system, where the volatile token counters invalidated the prefix on every request - Run the anchoring after every token saver, at the final body Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| chatCore | ||
| embeddingProviders | ||
| fetch | ||
| imageProviders | ||
| search | ||
| ttsProviders | ||
| chatCore.js | ||
| embeddingsCore.js | ||
| imageGenerationCore.js | ||
| responsesHandler.js | ||
| sttCore.js | ||
| ttsCore.js | ||
| videoCore.js | ||