Skip to main content

Makefile Reference

All common operations are wrapped in make targets. The router=<strategy> variable sets the routing strategy when starting the stack.

Targets

TargetDescription
make server-up router=<strategy>Build and start the production stack (real vLLM, GPU required)
make server-downStop and remove the production stack
make local-up router=<strategy>Build and start the dev stack (fake backends, no GPU)
make local-downStop and remove the dev stack
make healthCheck that all services are reachable and healthy
make local-testSend test requests directly to the fake backends (bypasses router)
make logsFollow Docker Compose logs for all running services

Strategy Values

The router= variable accepts:

  • roundrobin
  • consistanthashing
  • leastqueue

Example:

make local-up router=leastqueue