Logo SVG copied to clipboard
New Manifest is becoming the self-healing layer for APIs Read more

Use OpenAI SDK with Manifest

273M tokens / 30 days
App AI SDK

The OpenAI Python and TypeScript SDKs talk to any OpenAI-compatible endpoint. Point them at Manifest by setting OPENAI_BASE_URL and every chat completion, response, tool call, or Agents SDK loop routes through the right model.

203 models routed through Manifest over the last 30 days.

Why use the OpenAI SDK with Manifest

Chatty workloads (Agents SDK loops, tool retries, chain-of-thought reasoning) burn tokens fast. Manifest intercepts each call, picks the right model, and keeps your code identical. Same SDK, same shapes, lower bill.

  • One env var change: OPENAI_BASE_URL
  • Slash token spend by 50–70% on chatty agent loops
  • Works for the OpenAI SDK and the OpenAI Agents SDK
  • Tool calling, structured outputs, and streaming all pass through
  • Per-app spend caps and audit logs in the dashboard
  • Open source: inspect and self-host the router

Setup in 60 seconds

Set two environment variables and the OpenAI SDK picks them up on the next run, no code changes required.

Point the SDK at Manifest by setting these env vars in your shell or .env file:

export OPENAI_BASE_URL="https://api.manifest.build/v1"
export OPENAI_API_KEY="mnfst_YOUR_KEY"

Then use the SDK exactly as you would normally. Just point at "auto" to let Manifest pick the model:

from openai import OpenAI

client = OpenAI()

response = client.chat.completions.create(
    model="auto",
    messages=[{"role": "user", "content": "Hello"}],
)
OPENAI_BASE_URL https://api.manifest.build/v1
OPENAI_API_KEY mnfst_YOUR_KEY
model auto

OpenAI SDK tokens processed on Manifest

Models in use

# Model
Auth type Tokens / last 30 days
1.Gpt 5.6 Luna Pro
API Key108 M
2.Gpt 5.6 Sol
Subscription49 M
3.Gpt 5.3 Codex Spark
Subscription27 M
4.Gpt 5.4 Mini
Subscription11 M
5.Grok 4.5
Subscription11 M
6.Deepseek V4 Flash
Subscription10 M
7.Nemotron 3 Nano Omni 30b A3b Reasoning
API Key10 M
8.Claude Sonnet 5
Subscription9 M
9.Gpt 5.6 Luna
Subscription6 M
10.Deepseek V4 Pro
API Key6 M
11.Hy3
API Key6 M
12.Gemini 3.1 Flash Lite
API Key4 M
13.Gpt 5.6 Terra
API Key4 M
14.Openrouter Free
API Key1 M
15.Kilo Auto Free
API Key1 M
16.Claude Opus 5
Subscription936 K
17.Gpt 5.5
Subscription924 K
18.Gpt 5.6 Luna
API Key891 K
19.Grok 4.6
Subscription629 K
20.Gpt 5.6 Terra
Subscription606 K
21.Ox Alpha
API Key601 K
22.Gpt 4o Mini
API Key590 K
23.Deepseek V4 Flash Vision Exp
Subscription510 K
24.Gpt 5.4 Mini
API Key473 K
25.Claude Fable 5 1
Subscription388 K
26.Gpt 5.6 Luna
Subscription385 K
27.Mistral Small Latest
API Key381 K
28.Qwen3.8 Max
Subscription311 K
29.Gpt 5.4
Subscription241 K
30.Minimax M3
Subscription239 K
31.Gemini 2.5 Flash
Subscription196 K
32.Gemma 4 31b It
API Key179 K
33.Minimax M3
API Key170 K
34.Glm 5.3 Flash
Subscription158 K
35.Nex N2.5 Pro
API Key156 K
36.Claude Haiku 4 5
Subscription155 K
37.Laguna S 2.1
Subscription120 K
38.Deepseek Flash
Subscription111 K
39.Qwen3.7 Plus
Subscription102 K
40.Big Pickle
API Key101 K
41.Gemma4:31b
Subscription98 K
42.Mistral Medium Latest
API Key88 K
43.Gpt 4o 2024 08 06
Subscription69 K
44.Glm 5.3
Subscription65 K
45.Deepseek V4.1 Flash
Subscription37 K
46.Grok Build 0.1
Subscription36 K
47.Gemini 3.7 Flash
API Key31 K
48.Claude Opus 4 8
Subscription30 K
49.Gpt 5 Mini
Subscription30 K
50.MiniMax M3
Subscription27 K
51.Gpt 5.6 Luna
Subscription26 K
52.Minimax M3
Subscription24 K
53.Glm 5.3 Flash
Subscription23 K
54.Kimi K3
API Key22 K
55.Muse Spark 1.2 Contributor
API Key16 K
56.Nemotron 3 Nano Omni 30b A3b Reasoning
API Key16 K
57.Kimi K3
Subscription15 K
58.Qwen3.8 Flash
Subscription14 K
59.Grok 4.3
Subscription14 K
60.Gpt 4o
Subscription9 K
61.Glm 4.6
Subscription9 K
62.Claude Sonnet 4 6
Subscription6 K
63.MiniMax M2.5 Highspeed
Subscription6 K
64.Nemotron 3.5 Lightning
API Key5 K
65.Gpt 5.6 Sol Pro
Subscription5 K
66.Gpt 5.6 Terra Pro
Subscription5 K
67.Gpt 5.6 Luna Pro
Subscription5 K
68.Deepseek V4 Flash Latest
API Key5 K
69.Gpt Oss 120b
API Key4 K
70.Gpt 5.4 Nano
API Key3 K
71.Mistral Medium 2604
API Key3 K
72.Step 3.7 Flash
API Key2 K
73.Kimi K2.7 Code
API Key2 K
74.Qwen3.5 Flash
API Key1 K
75.Codestral 2508
API Key876
76.Kimi K2.7 Code
Subscription574
77.Grok Build 0.1
Subscription514
78.Lfm 2.5 2.6b
API Key421
79.Laguna S 2.1
API Key352
80.Qwen3.6 Max Preview
Subscription304
81.Deepseek V4 Flash
Subscription296
82.Mimo V2.5 Pro
Subscription267
83.Mimo V2.5
Subscription263
84.Glm 4.6
Subscription235
85.Glm 4.5
Subscription214
86.Deepseek V4 Pro
Subscription198
87.Grok 4.20 0309 Reasoning
Subscription197
88.Grok 4.20 0309 Non Reasoning
Subscription193
89.Glm 4.5 Air
Subscription183
90.Qwen3.8 Max 0902
Subscription154
91.Claude Sonnet 4
Subscription148
92.Claude Opus 4.7
Subscription133
93.Claude Fable 5
Subscription128
94.Claude Opus 5
Subscription120
95.Claude Opus 4.8
Subscription100
96.Deepseek V4 Pro 0813
Subscription99
97.Nemotron 3 Ultra 550b A55b
Subscription96
98.Gpt 5.2
Subscription85
99.Gpt 5.4 Pro
Subscription84
100.Claude Fable 5
API Key78
101.Ling 3.0 Flash Fin
API Key78
102.Solar Pro 3
Subscription78
103.Gpt 5.5
Subscription73
104.Gpt 5.1
Subscription69
105.Longcat 2.0 Free
API Key64
106.Claude Sonnet 5
Subscription62
107.Laguna Xs 2.1
Subscription61
108.Claude Fable 5
Subscription60
109.Gpt 4o
Subscription60
110.Solar Pro4
Subscription60
111.Claude Haiku 4.5
Subscription54
112.Claude Opus 4.1
Subscription54
113.Claude Opus 4.5
Subscription54
114.Claude Opus 4.6
Subscription54
115.Claude Sonnet 4.5
Subscription54
116.Claude Sonnet 4.6
Subscription54
117.Gpt 5.2 Pro
Subscription51
118.Gpt 5.4 Mini
Subscription51
119.Gpt 4.1
Subscription48
120.Gpt 4.1 Mini
Subscription48
121.Gpt 4.1 Nano
Subscription47
122.Deepseek V4 Flash 0731
Subscription46
123.Deepseek V4 Flash Latest
Subscription46
124.Gpt 4o Mini
Subscription45
125.Glm 5.2
Subscription45
126.Gpt 4 Turbo
Subscription43
127.Gpt 3.5 Turbo
Subscription42
128.Gemini 3.1 Pro Preview
Subscription39
129.Gemini 3.6 Flash
Subscription39
130.Gemini 2.5 Pro
Subscription37
131.Gemini 3.5 Flash
Subscription37
132.Gemini 3.7 Flash
Subscription36
133.Gpt 5
Subscription36
134.Gpt 5.4
Subscription36
135.Gpt 5 Mini
Subscription36
136.Gpt 5 Nano
Subscription36
137.Gpt 5 Pro
Subscription36
138.O3 Pro
Subscription36
139.Gpt 5 Codex
Subscription35
140.Gpt 5.4 Nano
Subscription34
141.Nemotron 3 Nano 30b A3b
Subscription32
142.Nemotron 3 Super 120b A12b
Subscription32
143.Mistral Medium 2312
API Key29
144.Gpt 5.2 Codex
Subscription28
145.Gpt 5.5 Pro
Subscription28
146.Glm 5
Subscription28
147.Glm 5.3
Subscription28
148.Glm Latest
Subscription28
149.Gpt 5.1 Codex Mini
Subscription27
150.Aion 2.0
Subscription26
151.Aion 3.0 Mini
Subscription26
152.Qwen3.7 Max
Subscription26
153.Gemini 3.5 Flash
API Key25
154.Gemma 3 27b It
Subscription25
155.Nemotron 3.5 Lightning
Subscription25
156.Aion 3.0
Subscription24
157.Gemini 3.1 Flash Lite
Subscription24
158.Gemini 3.5 Flash Lite
Subscription24
159.Gemini 3 Flash Preview
Subscription24
160.Claude Fable Latest
Subscription22
161.Gemini 2.5 Flash
Subscription22
162.Gemini 2.5 Flash Lite
Subscription22
163.Glm 4.6v
Subscription22
164.Gemma 4 26b A4b It
Subscription21
165.Gemma 4 31b It
Subscription21
166.Glm 4.5v
Subscription21
167.Glm 4.7
Subscription21
168.Glm 4.7 Flash
Subscription21
169.Glm 5.1
Subscription21
170.Glm 5 Turbo
Subscription21
171.Glm 5v Turbo
Subscription21
172.Llama 3.3 70b Instruct
Subscription20
173.Claude Opus Latest
Subscription20
174.Claude Sonnet Latest
Subscription20
175.Claude 3 Haiku
Subscription18
176.Claude Haiku Latest
Subscription18
177.Claude Opus 4
Subscription18
178.Claude Sonnet 4
Subscription18
179.Gemma 3 12b It
Subscription18
180.Gpt 5.3 Codex
Subscription18
181.Qwen3 Max
Subscription16
182.Qwen3 Max Thinking
Subscription16
183.Gpt 3.5 Turbo 16k
Subscription15
184.Gpt 4o 2024 05 13
Subscription15
185.Gpt 4o 2024 08 06
Subscription15
186.Gpt 4o 2024 11 20
Subscription15
187.Gpt 4o Mini 2024 07 18
Subscription15
188.Glm 5.2:US
Subscription15
189.Gemini 3.1 Pro Preview Customtools
Subscription14
190.Gpt 4
Subscription14
191.Gpt 5.4
API Key13
192.Gemini 2.5 Pro Preview 05 06
Subscription13
193.Gemini Flash Latest
Subscription13
194.Gemini Pro Latest
Subscription13
195.Gemini Flash Lite Latest
API Key12
196.Gemini 2.5 Pro Preview
Subscription12
197.Codestral 2508
Subscription12
198.Gpt 5.1 Codex
Subscription12
199.Gpt 5.1 Codex Max
Subscription12
200.Nova Pro V1
Subscription9
201.Gemini 3.1 Flash Lite Preview
Subscription9
202.Command R 08 2024
Subscription8
203.Command R Plus 08 2024
Subscription8