spec: tools/list SHOULD return tools in deterministic order#2516
Merged
spec: tools/list SHOULD return tools in deterministic order#2516
Conversation
Deterministic ordering enables clients to reliably cache the tool list and improves LLM prompt cache hit rates when tools are included in model context. https://claude.ai/code/session_01H7kpkCRQzoCrWm5YEpCXL4
|
Preview deployment for your docs. Learn more about Mintlify Previews.
|
pja-ant
previously approved these changes
Apr 4, 2026
Contributor
pja-ant
left a comment
There was a problem hiding this comment.
hmm, this is fine, but really its the host's job to figure this stuff out. Having a consistent order on the wire doesn't really guarantee that it ends up on the model API in a consistent order. Hopefully clients aren't asking servers for tools more often than the cache TTL... doesn't hurt to say this though.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Deterministic ordering enables clients to reliably cache the tool list
and improves LLM prompt cache hit rates when tools are included in
model context.