vllm‑helper

vllm-helper recipes

Tested launch configurations for known-good models

Tested launch configurations: each pins a model, image and flags. 'recipes launch' starts one as containers on the nodes you name, over SSH for any that are not this machine.

Usage

vllm-helper recipes

View this page as Markdown