vllm-helper node
Register machines by HTTP URL and SSH target
Register machines by HTTP URL (--host) and SSH target (--ssh). Recipes, pools and sharding name them with --nodes.
Usage
vllm-helper node
Register machines by HTTP URL and SSH target
Register machines by HTTP URL (--host) and SSH target (--ssh). Recipes, pools and sharding name them with --nodes.
vllm-helper node