vllm-helper install-gguf
Install the plugin that lets vLLM load GGUF models
Usage
vllm-helper install-gguf [flags]
Options
-y, --yes
| Type | bool |
install without asking
Install the plugin that lets vLLM load GGUF models
vllm-helper install-gguf [flags]
| Type | bool |
install without asking