Logo SVG copied to clipboard

Use Hermes with the LLM gateway

8.6B tokens / 30 days
Personal AI Agent

Hermes is a lightweight agent for delivering AI capabilities to your stack. Point it at the gateway endpoint and every request routes through the right model. Same Hermes config, smaller bill.

172 models routed through the gateway over the last 30 days.

Why use Hermes with the gateway

Hermes exposes a clean YAML-driven config for plugging in any OpenAI-compatible endpoint. Our LLM gateway is exactly that: a single endpoint that fans your traffic out to many providers, picks the right model per request, and surfaces cost in one dashboard.

  • One config.yaml change, zero workflow disruption
  • Save up to 70% on a typical Hermes workload
  • Switch between Claude, GPT, Gemini, and open models without rewriting prompts
  • Per-agent spend limits and rate caps
  • Real-time cost dashboards with token, model, and latency breakdowns
  • Open source, self-hostable, OpenAI-compatible

Setup in 60 seconds

Add the gateway endpoint to your Hermes config.yaml or run hermes model and pick "Custom endpoint".

Point Hermes at the gateway endpoint to route requests across multiple models.

Open the Hermes configuration file:

hermes config edit

Add the following model: section to your config.yaml: 

model:
  provider: custom
  base_url: https://api.manifest.build/v1
  api_key: mnfst_YOUR_KEY
  default: auto
provider custom
base_url https://api.manifest.build/v1
api_key mnfst_YOUR_KEY
default auto

Hermes tokens processed by the gateway

Models in use

# Model
 Auth type Tokens / last 30 days
1.Openai.Gpt 5.6 Sol
API Key1.8 B
2.Deepseek V4 Flash 0731
API Key868 M
3.Deepseek V4 Flash
Subscription669 M
4.Anthropic.Claude Sonnet 5
API Key539 M
5.Openrouter Free
API Key516 M
6.Glm 5.3 Flash
Subscription396 M
7.Deepseek V4.1 Flash
Subscription336 M
8.Qwen3.7 Flash
API Key298 M
9.Kilo Auto Free
API Key294 M
10.Openai.Gpt 5.6 Luna
API Key226 M
11.Mimo V2.5
Subscription167 M
12.Minimax M3
Subscription152 M
13.Gpt 5.6 Terra
Subscription148 M
14.Deepseek V4.1 Flash
Subscription138 M
15.Gpt 5.6 Sol
Subscription134 M
16.Grok 4.6
Subscription126 M
17.Gpt 5.6 Luna
Subscription122 M
18.Gemini 3.8 Flash
API Key114 M
19.Deepseek V4 Flash
API Key89 M
20.Grok 4.5
Subscription89 M
21.MiniMax M3
API Key88 M
22.Kimi K2.7 Code
Subscription84 M
23.Qwen3.6 Plus
Subscription83 M
24.Gemini 3.5 Flash Lite
API Key78 M
25.Gemini 3.7 Flash
API Key73 M
26.Hy3
API Key67 M
27.Deepseek V4 Flash Latest
API Key60 M
28.Deepseek V4 Flash 0731
API Key49 M
29.Deepseek V4 Pro
Subscription48 M
30.Deepseek V4 Flash Free
API Key47 M
31.Kimi K2.6
Subscription43 M
32.Gemini 3.1 Flash Lite
API Key43 M
33.Gemini 3.5 Flash
API Key40 M
34.Step 3.7 Flash
API Key39 M
35.Deepseek V4 Pro
API Key37 M
36.Qwen3.8 27B
API Key34 M
37.Deepseek V4 Pro
Subscription33 M
38.MiniMax M3
Subscription32 M
39.Deepseek V4 Pro 0813
API Key30 M
40.Gemini 3.6 Flash
API Key28 M
41.Glm 5.1
Subscription26 M
42.Gemini Flash Lite Latest
API Key23 M
43.Gpt 5.6 Luna
Subscription18 M
44.Gpt 5.5
Subscription17 M
45.Kimi K3
Subscription15 M
46.Glm 5.3
Subscription15 M
47.Muse Spark 1.2 Contributor
Subscription12 M
48.Glm 5.2
Subscription12 M
49.Nemotron 3 Ultra 550b A55b
API Key11 M
50.Gpt 5.6 Terra
API Key11 M
51.Kimi K3
API Key11 M
52.Muse Glimmer 30b
API Key11 M
53.Hy3
Subscription10 M
54.Glm 5.3
Subscription9 M
55.Nemotron 3 Ultra Free
API Key9 M
56.Deepseek V4 Flash
API Key9 M
57.Mistral Vibe Cli Latest
Subscription7 M
58.Ox Alpha
API Key6 M
59.Openai.Gpt 5.6 Terra
API Key6 M
60.Qwen3.7 Max
Subscription6 M
61.Deepseek V4 Flash 0731
Subscription5 M
62.Gpt 6 Astra
Subscription5 M
63.Nemotron 3 Super 120b A12b
API Key4 M
64.Mistral Small 2603
API Key4 M
65.Glm 5.3 Flash
API Key4 M
66.Ministral 14b Latest
API Key4 M
67.Big Pickle
API Key3 M
68.Ling 3.0 Flash VL
API Key3 M
69.Nemotron 3 Ultra 550b A55b
API Key3 M
70.Minimax M3
API Key3 M
71.O4 Mini
API Key2 M
72.Moonshotai.Kimi K2.5
API Key2 M
73.Claude Sonnet 5
Subscription2 M
74.Nemotron 3 Super 120b A12b
API Key2 M
75.Mimo V2.5
API Key2 M
76.Devstral 2512
API Key2 M
77.Nemotron 3.5 Lightning
API Key2 M
78.Deepseek Flash
Subscription2 M
79.Mimo V2.5 Free
API Key2 M
80.Claude Opus 5
Subscription1 M
81.Gpt 4o
Subscription1 M
82.Starcoder2 15b
API Key967 K
83.Deepseek V4 Flash Vision Exp
API Key958 K
84.Gemini 2.5 Flash Lite
API Key953 K
85.Gpt 5.4
Subscription946 K
86.Laguna Xs 2.1
API Key927 K
87.Gemini 3.1 Flash Lite Preview
API Key882 K
88.Step 3.7 Flash
API Key872 K
89.Gpt 4o Mini
API Key846 K
90.Gpt Oss 120b
API Key634 K
91.Gemini 2.5 Flash
API Key622 K
92.Gemma 4 31b It
API Key545 K
93.Anthropic.Claude Opus 5
API Key445 K
94.Solar Pro4
API Key337 K
95.Deepseek Flash
API Key327 K
96.Mistral Nemotron
API Key321 K
97.Gemini Flash Latest
API Key297 K
98.Kimi For Coding
Subscription235 K
99.Inkling
API Key233 K
100.Qwen.Qwen3 Coder 30b A3b Instruct
API Key233 K
101.Nemotron 3 Nano Omni 30b A3b Reasoning
API Key225 K
102.Mistral Medium 2508
API Key216 K
103.DeepSeek V4.1 Flash
API Key214 K
104.Grok 4.3
Subscription196 K
105.Laguna S 2.1
API Key194 K
106.Glm 5
Subscription194 K
107.Gemini 3 Flash Preview
API Key161 K
108.MiniMax M2
API Key147 K
109.Minimax M3
API Key136 K
110.Qwen3.8 Flash
Subscription120 K
111.Glm 5.1
Subscription116 K
112.Anthropic.Claude Fable 5
API Key113 K
113.Minimax M2.5
Subscription109 K
114.Nemotron 3 Nano Omni 30b A3b Reasoning
API Key103 K
115.MiniMax M2.7
Subscription103 K
116.Zai.Glm 4.7 Flash
API Key103 K
117.Qwen3.8 27b
API Key102 K
118.X Preview F Free
API Key72 K
119.Deepseek V4.1 Flash
API Key69 K
120.Qwen3.8 Flash
API Key63 K
121.Claude Sonnet 4 6
API Key59 K
122.Gemini 2.5 Pro
API Key35 K
123.Grok Build 0.1
Subscription32 K
124.Gemma 4 26b A4b It
API Key32 K
125.Gemma 4 31b It
API Key20 K
126.Nemotron 3.5 Lightning Free
API Key18 K
127.Gemini 3.1 Flash Lite
Subscription12 K
128.Gpt Oss Safeguard 20b
API Key12 K
129.Zai.Glm 5
API Key10 K
130.Gpt 4o
API Key10 K
131.Openai.Gpt Oss 20b
API Key7 K
132.Qwen.Qwen3 Coder Next
API Key6 K
133.Mistral.Ministral 3 14b Instruct
API Key6 K
134.Nvidia.Nemotron Nano 3 30b
API Key6 K
135.Nvidia.Nemotron Super 3 120b
API Key6 K
136.Gpt Oss 20b
API Key2 K
137.Lfm 2.5 2.6b
API Key2 K
138.Dots 3 Note Preview
API Key2 K
139.Nemotron 3.5 Lightning 30b A3b
API Key2 K
140.North Mini Code
API Key1 K
141.Llama 3.2 11b Vision Instruct
API Key1 K
142.Ling 3.0 Flash Sante
API Key1 K
143.Ling 3.0 Flash Fin
API Key1 K
144.Nemotron 3 Nano 30b A3b
API Key985
145.Nex N2.5 Pro
API Key980
146.Qwen3.6 27b
API Key942
147.Efficient
API Key856
148.Ling 3.0 Flash Fin Free
API Key761
149.Laguna Xs 2.1
API Key578
150.Llama 3.2 90b Vision Instruct
API Key525
151.Diffusiongemma 26b A4b It
API Key263
152.Gemma 4 31b It
API Key252
153.Gpt 5 Mini
API Key184
154.Mistral Nemo Minitron 8b 8k Instruct
API Key128
155.Deepseek V4 Pro 0813
API Key89
156.Glm 5.2
Subscription57
157.Gpt 4.1 Mini
API Key53
158.Deepseek V4 Flash Vision Exp
Subscription36
159.Ling 3.0 Flash Vl
API Key27
160.Deepseek V3.2
API Key16
161.Nex N2.5 Mini
API Key16
162.Claude Haiku Latest
API Key13
163.Deepseek V4 Pro
API Key11
164.Deepseek R1 0528
API Key11
165.Deepseek Chat
API Key10
166.Deepseek Chat V3.1
API Key10
167.Deepseek V3.1 Terminus
API Key10
168.Deepseek V3.2 Exp
API Key10
169.Deepseek Chat V3 0324
API Key9
170.Deepseek R1
API Key9
171.Gemini 3.8 Flash
API Key3
172.Gemini 3.7 Flash
API Key2

Explore more agents

n8n OpenClaw Claude Code