900M tokens / 30 days

App AI SDK

The OpenAI Python and TypeScript SDKs talk to any OpenAI-compatible endpoint. Point them at Manifest by setting OPENAI_BASE_URL and every chat completion, response, tool call, or Agents SDK loop routes through the right model.

79 models routed through Manifest over the last 30 days.

Why use the OpenAI SDK with Manifest

Chatty workloads (Agents SDK loops, tool retries, chain-of-thought reasoning) burn tokens fast. Manifest intercepts each call, picks the right model, and keeps your code identical. Same SDK, same shapes, lower bill.

One env var change: OPENAI_BASE_URL
Slash token spend by 50–70% on chatty agent loops
Works for the OpenAI SDK and the OpenAI Agents SDK
Tool calling, structured outputs, and streaming all pass through
Per-app spend caps and audit logs in the dashboard
Open source: inspect and self-host the router

Setup in 60 seconds

Set two environment variables and the OpenAI SDK picks them up on the next run, no code changes required.

Point the SDK at Manifest by setting these env vars in your shell or .env file:

export OPENAI_BASE_URL="https://api.manifest.build/v1"
export OPENAI_API_KEY="mnfst_YOUR_KEY"

Then use the SDK exactly as you would normally. Just point at "auto" to let Manifest pick the model:

from openai import OpenAI

client = OpenAI()

response = client.chat.completions.create(
    model="auto",
    messages=[{"role": "user", "content": "Hello"}],
)

import OpenAI from "openai";

const client = new OpenAI();

const response = await client.chat.completions.create({
  model: "auto",
  messages: [{ role: "user", content: "Hello" }],
});

OPENAI_BASE_URL https://api.manifest.build/v1

OPENAI_API_KEY mnfst_YOUR_KEY

model auto

OpenAI SDK tokens processed on Manifest

Models in use

# Model	Auth type	Tokens / last 30 days
1.MiniMax M3	Subscription	393 M
2.Gemini 3.5 Flash Lite	API Key	244 M
3.Gpt 5.6 Terra	Subscription	65 M
4.Gpt 5.6 Sol	Subscription	52 M
5.Nemotron 3 Nano Omni 30b A3b Reasoning	API Key	23 M
6.Gpt 5.3 Codex Spark	Subscription	23 M
7.Gpt 5.4 Mini	Subscription	21 M
8.Gemini 3.1 Pro Preview	Subscription	12 M
9.Claude Haiku 4 5	Subscription	9 M
10.Gemini 3.6 Flash	API Key	9 M
11.Qwen3.7 Flash	API Key	5 M
12.Step 3.7 Flash	API Key	4 M
13.Gemma4:31b	Subscription	4 M
14.Nemotron 3 Nano Omni 30b A3b Reasoning	API Key	4 M
15.Hy3	API Key	4 M
16.Deepseek V4 Flash	API Key	4 M
17.Kimi K3	Subscription	3 M
18.Gemini 3.1 Flash Lite	API Key	3 M
19.Gemma 4 31b It	API Key	3 M
20.Openrouter Free	API Key	2 M
21.Gpt 4o Mini	API Key	2 M
22.Claude Opus 4 8	Subscription	2 M
23.Nemotron 3.5 Lightning	API Key	1 M
24.Deepseek V4 Flash Free	API Key	1 M
25.Gemini 3.5 Flash	API Key	1 M
26.Gpt 5.5	Subscription	1 M
27.Gpt 5.6 Luna	Subscription	1 M
28.Claude Sonnet 5	Subscription	1 M
29.Grok 4.5	Subscription	855 K
30.Gemini Flash Latest	API Key	835 K
31.Gemini 2.5 Flash	Subscription	497 K
32.Kilo Auto Free	API Key	452 K
33.Gpt 4o 2024 08 06	Subscription	426 K
34.Mistral Small Latest	API Key	381 K
35.Gpt 5.4	Subscription	270 K
36.Gemma 4 26b A4b It	API Key	199 K
37.Gpt Oss 120b	API Key	145 K
38.Glm 5.1	Subscription	121 K
39.Gemini 2.5 Flash Lite	Subscription	92 K
40.Claude Opus 5	Subscription	92 K
41.Gpt Oss 120b	API Key	88 K
42.Mistral Medium Latest	API Key	87 K
43.Glm 5.3	Subscription	52 K
44.Mimo V2.5 Free	API Key	46 K
45.Deepseek R1 Distill Llama 70b	API Key	40 K
46.Gemini 3.7 Flash	API Key	31 K
47.Gemma 4 31b It	API Key	26 K
48.Claude Sonnet 4 6	Subscription	25 K
49.Claude Opus 4 6	Subscription	22 K
50.Gemini 3 Flash Preview	Subscription	13 K
51.Llama 3.3 70b Versatile	API Key	12 K
52.Gpt 4o	Subscription	8 K
53.Gpt 5.4 Nano	API Key	7 K
54.Deepseek V4 Pro	API Key	7 K
55.Qwen3.6 Flash	API Key	4 K
56.Kimi K3	API Key	2 K
57.Qwen3.5 Flash	API Key	1 K
58.Big Pickle	API Key	1 K
59.Codestral 2508	API Key	876
60.Gpt 4o	API Key	437
61.Glm 4.5 Air	Subscription	377
62.Gpt 5.5	API Key	312
63.Glm 5	Subscription	249
64.Claude Opus 4	Subscription	224
65.Gemini 3.5 Flash	API Key	216
66.Glm 4.6	Subscription	130
67.Glm 4.5	Subscription	113
68.Glm 5.2	Subscription	77
69.Glm 5 Turbo	Subscription	70
70.Glm 4.7	Subscription	52
71.Gemini 2.5 Flash	API Key	48
72.Claude Haiku 4 5 20251001	API Key	45
73.Gemini 2.5 Pro	Subscription	43
74.Claude Fable 5	Subscription	37
75.Claude Sonnet 4 6	API Key	19
76.Claude Sonnet 5	API Key	14
77.Gemini Flash Lite Latest	API Key	12
78.Gemini 3.5 Flash Lite	API Key	11
79.Gemini 3.1 Flash Lite	Subscription	6

Use OpenAI SDK with Manifest

Why use the OpenAI SDK with Manifest

Setup in 60 seconds

OpenAI SDK tokens processed on Manifest

Models in use

Explore more agents