•
LLM calls that don't break
Manifest is the only LLM Gateway that auto-fixes your bad requests on the fly.
Trusted by engineers who ship at
- OpenAI Compatible
- Bring your own key
- Custom providers
- Local models
Who uses Manifest?
Manifest is an open source LLM Gateway that helps builders and teams create reliable agents and workflows, and manage their inference consumption.
AI builders
Connect your subscription plans, BYOK providers and local models with your harness in seconds. Customize your routing and maximize your plans.
Manifest for AI buildersTeams & startups
Manage your inference consumption and settings, and track every request and token through a beautiful interface.
Manifest for teamsPlatforms & providers
Don't let avoidable client errors harm your users' experience and your revenue. Help them connect smoothly to models.
Manifest for platforms5% of LLM API calls fail in production. Most of those errors are avoidable.
Ensure zero downtime by fixing issues on the fly with Manifest Auto-fix. Our agent repairs the request before it ever comes back to yours. Available through the LLM Gateway or standalone.
Source: Datadog, State of AI Engineering
Everything you need to keep your agents running
Model fallbacks
Automatically retry on another provider when one goes down.
Full body logs
Inspect the complete request and response body for every call.
Auto-fix
Broken requests get repaired on the fly, before your agent sees the error.
Self-host
Run the whole LLM router on your infrastructure or your machine. Free and open source.
Local models
Route to Ollama, LM Studio, llama.cpp or any local server. Decide what goes to the cloud and what stays on your machine.
Bring your own key
Bring your own keys for every provider and pay usage directly. Manifest allows API keys from all popular providers and OAuth tokens for subscriptions.
Easy parameter setup
Set the right model and parameters per route without touching the code. Set AI model parameters visually.
Cost visualization
See every dollar spent, broken down by agent, key and provider.
Built in the open
Manifest is fully open source. Use our cloud version for easy onboarding or our self-hosted version based on Docker. We encourage you to participate in this project.
Join the community
Chat with the team and meet the community! Ask questions, no such thing as a stupid question here.
Join Manifest Discord ServerGitHub
Read the source and contribute to the project.
Docker Hub
Get the latest image from Manifest and use it locally!
Error catalog
Understand and fix common avoidable errors from LLM APIs. Browse our catalog to see errors classified by provider or type.
Browse the error catalog
Free models
Discover LLM APIs with free tiers for text inference. No trials or discounts, only permanent free requests.
See awesome-free-llm-apis
Modelparams.dev
An open, community-maintained catalog of model parameters available through UI, API or NPM package.
Explore modelparams.devDon't let LLM API errors reduce the value of your workflows, apps and agents.
Build reliable products now.
Why Manifest?
AI is an incredible technology, but products that implement it aren't yet as reliable as the pre-AI ones.
Companies use AI to enhance the value they provide to their customers, and should focus on that rather than spending their time fixing it. Manifest helps builders create reliable AI products, understanding how inference is consumed and when it fails.
We all deserve reliable AI, from the established company implementing AI at scale to the hacker building agents at 2:00 AM.
Requests routed through Manifest
7,415,303