Logo SVG copied to clipboard
New Manifest is becoming the self-healing layer for APIs Read more

Use OpenAI SDK with Manifest

250M tokens / 30 days
App AI SDK

The OpenAI Python and TypeScript SDKs talk to any OpenAI-compatible endpoint. Point them at Manifest by setting OPENAI_BASE_URL and every chat completion, response, tool call, or Agents SDK loop routes through the right model.

83 models routed through Manifest over the last 30 days.

Why use the OpenAI SDK with Manifest

Chatty workloads (Agents SDK loops, tool retries, chain-of-thought reasoning) burn tokens fast. Manifest intercepts each call, picks the right model, and keeps your code identical. Same SDK, same shapes, lower bill.

  • One env var change: OPENAI_BASE_URL
  • Slash token spend by 50–70% on chatty agent loops
  • Works for the OpenAI SDK and the OpenAI Agents SDK
  • Tool calling, structured outputs, and streaming all pass through
  • Per-app spend caps and audit logs in the dashboard
  • Open source: inspect and self-host the router

Setup in 60 seconds

Set two environment variables and the OpenAI SDK picks them up on the next run, no code changes required.

Point the SDK at Manifest by setting these env vars in your shell or .env file:

export OPENAI_BASE_URL="https://api.manifest.build/v1"
export OPENAI_API_KEY="mnfst_YOUR_KEY"

Then use the SDK exactly as you would normally. Just point at "auto" to let Manifest pick the model:

from openai import OpenAI

client = OpenAI()

response = client.chat.completions.create(
    model="auto",
    messages=[{"role": "user", "content": "Hello"}],
)
OPENAI_BASE_URL https://api.manifest.build/v1
OPENAI_API_KEY mnfst_YOUR_KEY
model auto

OpenAI SDK tokens processed on Manifest

Models in use

# Model
Auth type Tokens / last 30 days
1.Gpt 5.6 Luna Pro
API Key85 M
2.Gpt 5.6 Sol
Subscription49 M
3.Gpt 5.3 Codex Spark
Subscription24 M
4.Gpt 5.4 Mini
Subscription12 M
5.Deepseek V4 Flash
Subscription10 M
6.Claude Sonnet 5
Subscription9 M
7.Grok 4.5
Subscription8 M
8.Deepseek V4 Pro
API Key6 M
9.Hy3
API Key5 M
10.MiniMax M3
Subscription5 M
11.Nemotron 3 Nano Omni 30b A3b Reasoning
API Key4 M
12.Step 3.7 Flash
API Key4 M
13.Gemini 3.1 Flash Lite
API Key4 M
14.Openrouter Free
API Key3 M
15.Nemotron 3 Nano Omni 30b A3b Reasoning
API Key3 M
16.Gpt 5.6 Terra
API Key2 M
17.Gpt 5.6 Luna
Subscription2 M
18.Nemotron 3.5 Lightning
API Key1 M
19.Kilo Auto Free
API Key1 M
20.Deepseek V4 Flash Free
API Key1 M
21.Gpt 5.5
Subscription968 K
22.Claude Opus 5
Subscription936 K
23.Gemini Flash Latest
API Key835 K
24.Gpt 5.6 Luna
API Key740 K
25.Gpt 4o Mini
API Key725 K
26.Ox Alpha
API Key601 K
27.Gpt 5.6 Terra
Subscription556 K
28.Deepseek V4 Flash Vision Exp
Subscription510 K
29.Gemma 4 31b It
API Key403 K
30.Claude Fable 5 1
Subscription388 K
31.Gpt 5.6 Luna
Subscription385 K
32.Mistral Small Latest
API Key381 K
33.Qwen3.8 Max
Subscription311 K
34.Gemini 3.5 Flash Lite
API Key302 K
35.Gpt 5.4
Subscription279 K
36.Gemma4:31b
Subscription258 K
37.Minimax M3
Subscription239 K
38.Claude Haiku 4 5
Subscription208 K
39.Claude Opus 4 8
Subscription205 K
40.Gemini 2.5 Flash
Subscription204 K
41.Minimax M3
API Key170 K
42.Glm 5.3 Flash
Subscription158 K
43.Gpt Oss 120b
API Key139 K
44.Qwen3.7 Plus
Subscription102 K
45.Mistral Medium Latest
API Key88 K
46.Gpt 4o 2024 08 06
Subscription69 K
47.Gpt Oss 120b
API Key57 K
48.Glm 5.3
Subscription52 K
49.Laguna S 2.1
Subscription51 K
50.Grok 4.6
Subscription42 K
51.Deepseek R1 Distill Llama 70b
API Key40 K
52.Grok Build 0.1
Subscription36 K
53.Gemini 3.7 Flash
API Key31 K
54.Kimi K3
API Key22 K
55.Muse Spark 1.2 Contributor
API Key16 K
56.Grok 4.3
Subscription14 K
57.Gpt 5 Mini
Subscription14 K
58.Llama 3.3 70b Versatile
API Key12 K
59.Gpt 4o
Subscription9 K
60.Glm 4.6
Subscription9 K
61.Claude Sonnet 4 6
Subscription6 K
62.Gemma 4 31b It
API Key5 K
63.Deepseek V4 Flash Latest
API Key5 K
64.Mistral Medium 2604
API Key3 K
65.Kimi K2.7 Code
API Key2 K
66.Qwen3.8 Flash
Subscription2 K
67.Qwen3.5 Flash
API Key1 K
68.Codestral 2508
API Key876
69.Kimi K3
Subscription791
70.Kimi K2.7 Code
Subscription574
71.Lfm 2.5 2.6b
API Key421
72.Laguna S 2.1
API Key352
73.Grok 4.20 0309 Reasoning
Subscription197
74.Grok 4.20 0309 Non Reasoning
Subscription193
75.Claude Sonnet 4
Subscription148
76.Claude Fable 5
Subscription128
77.Claude Fable 5
API Key78
78.Ling 3.0 Flash Fin
API Key78
79.Longcat 2.0 Free
API Key64
80.Mistral Medium 2312
API Key29
81.Gemini 3.5 Flash
API Key25
82.Gpt 5.4
API Key13
83.Gemini Flash Lite Latest
API Key12