Millwright – Rust-based, self-hosted LLM router
Northwood-Systems built Millwright, a self-hosted LLM router, to provide a cost-effective and transparent solution. Millwright is an open-source router that can be used with various LLM models. The developer was motivated by the potential acquisition of OpenRouter and the proliferation of hosted LLM routers. Millwright aims to provide a self-hosted alternative with better performance.
Millwright offers a self-hosted solution for LLM routing, providing users with more control over their data and costs. This is particularly important for applications where data privacy and security are crucial.