vllm-helper shard status
Show sharded endpoint and runtime status
Usage
vllm-helper shard status --nodes n1,n2 [flags]
Options
--backend
| Type | string |
| Default | all |
backend to inspect: all, ray, or mp
--dry-run
| Type | bool |
print commands instead of running them
--head
| Type | string |
head node name (defaults to first --nodes entry)
--nodes
| Type | string |
comma-separated node names
--port
| Type | string |
API port to probe
--ssh-key
| Type | string |
SSH private key for non-head nodes