llm‑helper

llm-helper router serve

Run the router in the foreground

Usage

llm-helper router serve [--port N] [flags]

Options

--bind

Type string

address to listen on, overriding --port (default: loopback, or every interface when VLLM_API_KEY is set)

--port

Type string

port to listen on (default: ROUTER_PORT, else 8000)

View this page as Markdown