llm-helper router

Serve every running model behind one port

The router answers on one port and sends each request to the instance serving the model it names. Coder then offers every running model, not just one.

Usage

llm-helper router