Use OpenAI SDK with Manifest
The OpenAI Python and TypeScript SDKs talk to any OpenAI-compatible endpoint. Point
them at Manifest by setting OPENAI_BASE_URL
and every chat completion, response, tool call, or Agents SDK loop routes through
the right model.
76 models routed through Manifest over the last 30 days.
Why use the OpenAI SDK with Manifest
Chatty workloads (Agents SDK loops, tool retries, chain-of-thought reasoning) burn tokens fast. Manifest intercepts each call, picks the right model, and keeps your code identical. Same SDK, same shapes, lower bill.
- One env var change: OPENAI_BASE_URL
- Slash token spend by 50–70% on chatty agent loops
- Works for the OpenAI SDK and the OpenAI Agents SDK
- Tool calling, structured outputs, and streaming all pass through
- Per-app spend caps and audit logs in the dashboard
- Open source: inspect and self-host the router
Setup in 60 seconds
Set two environment variables and the OpenAI SDK picks them up on the next run, no code changes required.
Point the SDK at Manifest by setting these env vars in your shell or
.env file:
export OPENAI_BASE_URL="https://api.manifest.build/v1"
export OPENAI_API_KEY="mnfst_YOUR_KEY"
Then use the SDK exactly as you would normally. Just point at
"auto" to let Manifest pick the model:
from openai import OpenAI
client = OpenAI()
response = client.chat.completions.create(
model="auto",
messages=[{"role": "user", "content": "Hello"}],
)
import OpenAI from "openai";
const client = new OpenAI();
const response = await client.chat.completions.create({
model: "auto",
messages: [{ role: "user", content: "Hello" }],
});
https://api.manifest.build/v1
mnfst_YOUR_KEY
auto
OpenAI SDK tokens processed on Manifest
Models in use
# Model |
Auth type | Tokens / last 30 days |
|---|---|---|
1.MiniMax M3 | Subscription | 573 M |
2.Gpt 5.6 Sol | Subscription | 146 M |
3.Claude Sonnet 4 6 | Subscription | 95 M |
4.Claude Opus 4 6 | Subscription | 75 M |
5.Gpt 5.6 Terra | Subscription | 65 M |
6.Qwen3.5 9b | API Key | 61 M |
7.Glm 5.1 | Subscription | 60 M |
8.Mimo V2.5 Pro | API Key | 46 M |
9.Gpt 5.3 Codex Spark | Subscription | 33 M |
10.Gpt 4o Mini 2024 07 18 | API Key | 26 M |
11.Nemotron 3 Ultra 550b A55b | API Key | 25 M |
12.Hy3 | API Key | 24 M |
13.Gpt 5.4 Mini | Subscription | 21 M |
14.Gemma 4 31b It | API Key | 17 M |
15.Gemini 3.1 Pro Preview | Subscription | 15 M |
16.Nemotron 3 Nano Omni 30b A3b Reasoning | API Key | 14 M |
17.Glm 5.2 | Subscription | 14 M |
18.Claude Haiku 4 5 | Subscription | 10 M |
19.Kimi K3 | Subscription | 9 M |
20.Claude Fable 5 | Subscription | 6 M |
21.Gemma4:31b | Subscription | 5 M |
22.Gemini 3.5 Flash Lite | API Key | 5 M |
23.Glm 4.7 | Subscription | 4 M |
24.Gpt 4o Mini | API Key | 4 M |
25.Deepseek V4 Pro | API Key | 3 M |
26.Gemma 4 26b A4b It | API Key | 2 M |
27.Gpt 5.4 | Subscription | 1 M |
28.Gpt 5.5 | Subscription | 1 M |
29.Gemini 3.1 Flash Lite | API Key | 1 M |
30.Gemini 2.5 Flash | Subscription | 1 M |
31.Deepseek V4 Flash | Subscription | 531 K |
32.Gpt 5.2 | API Key | 430 K |
33.Llama 4 Scout 17b 16e Instruct | API Key | 427 K |
34.Gpt 4o | API Key | 331 K |
35.Claude Opus 4 8 | API Key | 296 K |
36.Qwen3 14b | API Key | 167 K |
37.Openrouter Free | API Key | 143 K |
38.Gpt 4o 2024 08 06 | Subscription | 124 K |
39.Gpt 4o 2024 08 06 | API Key | 117 K |
40.Kilo Auto Free | API Key | 103 K |
41.Gemini 2.5 Flash Lite | Subscription | 92 K |
42.MiniMax M2.7 | Subscription | 62 K |
43.Mimo V2.5 Free | API Key | 53 K |
44.Gemini 3 Flash Preview | Subscription | 46 K |
45.Gemini 3.5 Flash | API Key | 41 K |
46.Gpt 4o Mini | Subscription | 29 K |
47.Gemma 4 31b It | API Key | 18 K |
48.Gpt 4o | Subscription | 8 K |
49.O4 Mini | API Key | 7 K |
50.Deepseek V4 Pro | API Key | 7 K |
51.Qwen3.6 Flash | API Key | 4 K |
52.Gemini Pro Latest | API Key | 3 K |
53.Claude Sonnet 5 | Subscription | 2 K |
54.Gpt 5.4 Nano | API Key | 2 K |
55.Kimi K3 | API Key | 2 K |
56.Big Pickle | API Key | 1 K |
57.Claude Opus 5 | Subscription | 853 |
58.Gpt 5.4 Mini | API Key | 732 |
59.Claude Opus 4 8 | Subscription | 445 |
60.Gpt 5.6 Luna | Subscription | 364 |
61.Gpt 5.5 | API Key | 285 |
62.Gemini 3.5 Flash | API Key | 216 |
63.GLM 5.2 | Subscription | 159 |
64.Gpt 5.6 Luna | Subscription | 155 |
65.Gpt 5.4 | API Key | 128 |
66.MiniMax M2.5 Highspeed | Subscription | 116 |
67.Gemini 2.5 Flash | API Key | 48 |
68.Claude Haiku 4 5 20251001 | API Key | 45 |
69.Gpt 5.6 Terra | Subscription | 43 |
70.Gpt 5.6 Sol | Subscription | 42 |
71.Claude Sonnet 4 5 | Subscription | 40 |
72.Gemini 3.1 Flash Lite | Subscription | 27 |
73.Gpt 5.5 | Subscription | 20 |
74.Claude Sonnet 4 6 | API Key | 19 |
75.Claude Sonnet 5 | API Key | 14 |
76.Gemini 3.5 Flash Lite | API Key | 11 |