Repository navigation
[Docs] Fix default values and options in Ascend server arguments documentation - #22698
Merged
Merged
Conversation
Contributor
There was a problem hiding this comment.
Code Review
This pull request updates the documentation for Ascend NPU support features by refining the available options and default values for several server arguments, including --grpc-mode, --tool-call-parser, and speculative decoding settings. A typo was identified in the description for the --disaggregation-decode-enable-offload-kvcache argument.
sglang-npu-bot
approved these changes
Apr 13, 2026
caitengwei
pushed a commit
to caitengwei/sglang
that referenced
this pull request
Jun 1, 2026
…mentation (sgl-project#22698) Co-authored-by: xdtbynd <supercluster@vip.qq.com>
Chronostasys
pushed a commit
to MindLab-Research/sglang
that referenced
this pull request
Aug 24, 2026
…mentation (sgl-project#22698) Co-authored-by: xdtbynd <supercluster@vip.qq.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
This pull request updates the documentation for server arguments to accurately reflect the current defaults, available options, and support status for various features in the Ascend backend (A2, A3). Several descriptions were outdated or contained placeholder information. This change ensures users have correct configuration guidance and are aware of features still in planning.
Key issues addressed:
--speculative-draft-load-format.--tool-call-parseroptions to match the currently implemented parsers for Ascend.--disaggregation-decode-enable-offload-kvcache.Modifications
The following sections in the server arguments documentation have been updated:
HTTP Server:
--grpc-modeserver supported description to explicitly statePlanned.API related:
--tool-call-parser: Updated the list of valid options tollama3,pythonic,qwen, andqwen3_coderto reflect the currently supported parsers on the Ascend backend.--reasoning-parseroptions.Speculative decoding:
--speculative-draft-load-format: Changed the default value fromNonetoauto.--speculative-draft-model-revision: Expanded the "Options" description to include specific examples (branch name,tag name,commit id).Disaggregation:
--disaggregation-decode-enable-offload-kvcache: Updated the server supported column to server supported description to explicitly statePlannedto accurately indicate the current lack of support for KV cache offloading on Ascend.Accuracy Tests
N/A - This PR only updates documentation and does not modify any model forward code or kernel logic.
Speed Tests and Profiling
N/A - This PR only updates documentation and does not impact inference speed.
Checklist
Review and Merge Process
/tag-and-rerun-ci,/tag-run-ci-label,/rerun-failed-ci