Contributing
Contributions are welcome — whether that's reporting a bug, suggesting a new routing strategy, or submitting a pull request.
Reporting Issues
If you run into a bug or have a feature request, open an issue on GitHub:
github.com/sonephyo/llm-routing-bench/issues
Please include:
- What you were trying to do
- What happened vs. what you expected
- Relevant logs or error output
- Your OS, Docker version, and GPU setup (if applicable)
Submitting a Pull Request
- Fork the repository on GitHub
- Create a branch from
main:git checkout -b feat/your-feature-name - Make your changes and commit them
- Push your branch and open a pull request against
main - Describe what your PR does and why in the PR description
Ideas for Contributions
- New load balancing strategies (implement the
loadbalancer.Routerinterface in Go) - Additional benchmark scripts
- Documentation improvements
- Bug fixes