Open-source LLM router for agents. Connect your subscriptions, API keys, and local models to any harness through one endpoint, with fallbacks and spend limits.
Manifest is an open-source LLM router for agents and AI apps. Connect the providers you already use — subscriptions like ChatGPT or Claude, pay-per-token API keys, local models, and custom endpoints — and route every request through one OpenAI- and Anthropic-compatible URL.Send auto as the model and Manifest routes each request by the rules you set, with fallbacks when one fails. Pin a real model ID instead, and the request goes straight to that model, with no routing and no fallback. Either way, you cap what each harness spends and see the cost of every request.
Manifest is open source and runs two ways. Both speak the same API, so pointing a client at one or the other is a URL change.
Manifest Cloud
Runs on our servers. Sign up, connect a provider, and you’re routing.
Recommended if you’re starting out.
Self-hosting
Runs on infrastructure you control: Docker on your own machine, a managed
platform like Railway, your AWS or GCP account, or a server panel.
On the cloud there is nothing to install and nothing to configure on a server. You sign up, connect your providers, point your harness at the gateway URL, and everything else — routing, limits, Autofix, alerts — is a setting in the dashboard. The environment variables throughout these docs apply only to a Manifest instance you run yourself.Cloud is also subject to plan limits: the free plan includes 10,000 routed requests per calendar month, shown by the usage meter in the dashboard sidebar and reset at 00:00 UTC on the 1st. And it can’t reach local models running on your machine. A self-hosted instance has neither restriction.
Sign up at app.manifest.build and a guided setup walks you through it. Step one creates a harness. Then connect a provider, and give your default tier a model to route to. The last step shows the gateway address and the harness key, which starts with mnfst_. A harness you create later reuses the providers your workspace already has.
The guided setup after signing up: step one creates your first harness.
auto asks Manifest to route the request. The request appears on the Requests page with the model that served it and its cost.
Install Manifest first: Self-hosted covers Docker and the managed platforms. Your instance starts empty. First request takes you from there to a routed request, against http://localhost:2099/v1.
