vllm-helper pool install-service
Install a systemd service for the pool router
Writes a systemd unit that runs 'vllm-helper pool serve' with the given nodes. Linux hosts only.
Usage
vllm-helper pool install-service --nodes n1,n2 [flags]
Options
--bind
| Type | string |
| Default | :8011 |
Bind address for the router
--name
| Type | string |
| Default | vllm-pool-router.service |
systemd unit name
--nodes
| Type | string |
Comma-separated node names
--now
| Type | bool |
| Default | true |
enable and restart the service immediately
--sticky
| Type | string |
| Default | auto |
Stickiness (auto|authorization|header:Name)
--user
| Type | string |
user the router runs as (default: $USER)