vllm-helper shard install-ray
Install Ray into the vLLM virtualenv on cluster nodes
Usage
vllm-helper shard install-ray --nodes n1,n2 [flags]
Options
--dry-run
| Type | bool |
print commands instead of running them
--head
| Type | string |
head node name (defaults to first --nodes entry)
--nodes
| Type | string |
comma-separated node names
--python
| Type | string |
python executable to install Ray with (defaults next to VLLM_BIN)
--ssh-key
| Type | string |
SSH private key for non-head nodes