LLM gateways and observability for enterprise buyers
Asked as “LLM gateway”, and as “LLM observability and routing platform”, on behalf of an enterprise B2B company. 56 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
23%
Contested · LiteLLM 18%
23Bifrost18LiteLLM14Portkey45others
23% of first choices, contested.
Since October 2026↗new leaderNew leader since October 2026: Bifrost (23%) replaces Portkey (26% then, 14% now), 9 points clear, inside the 11-point floor.Bifrost leads at 23%, replacing Portkey, which led at 26% and stands at 14% now: 9 points clear, inside the floor, so the swap reads as unsettled.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Portkey36%Contested↗new leaderNew leader since October 2026: Portkey (36%) replaces LiteLLM (31% then, 33% now), 3 points clear, inside the 11-point floor.Standing →Mid-market
LiteLLM36%Contested↗new leaderNew leader since October 2026: LiteLLM (36%) replaces Portkey (33% then, 32% now), 4 points clear, inside the 11-point floor.Standing →Enterprise
Bifrost23%Contested↗new leaderNew leader since October 2026: Bifrost (23%) replaces Portkey (26% then, 14% now), 9 points clear, inside the 11-point floor.This page
Portkey36%Contested↗new leaderNew leader since October 2026: Portkey (36%) replaces LiteLLM (31% then, 33% now), 3 points clear, inside the 11-point floor.Standing →Mid-marketLiteLLM36%Contested↗new leaderNew leader since October 2026: LiteLLM (36%) replaces Portkey (33% then, 32% now), 4 points clear, inside the 11-point floor.Standing →EnterpriseBifrost23%Contested↗new leaderNew leader since October 2026: Bifrost (23%) replaces Portkey (26% then, 14% now), 9 points clear, inside the 11-point floor.This pageThe standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01Bifrost23%4%46accepted challenger▲+8Since October 2026: 15% → 23%, +8 points. Inside the 11-point floor: within noise.15% → 23%
Bifrost23%4%46accepted challenger▲+8Since October 2026: 15% → 23%, +8 points. Inside the 11-point floor: within noise.15% → 23%02LiteLLM18%34%58criticized challenger▼−8Since October 2026: 26% → 18%, −8 points. Inside the 11-point floor: within noise.26% → 18%
LiteLLM18%34%58criticized challenger▼−8Since October 2026: 26% → 18%, −8 points. Inside the 11-point floor: within noise.26% → 18%03Portkey14%12%49accepted challenger▼−12Since October 2026: 26% → 14%, −12 points. Past the 11-point floor: movement.26% → 14%
Portkey14%12%49accepted challenger▼−12Since October 2026: 26% → 14%, −12 points. Past the 11-point floor: movement.26% → 14%04
Kong AI Gateway4%2%47accepted challenger▼−2Since October 2026: 6% → 4%, −2 points. Inside the 11-point floor: within noise.6% → 4%
Kong AI Gateway4%2%47accepted challenger▼−2Since October 2026: 6% → 4%, −2 points. Inside the 11-point floor: within noise.6% → 4%05
Langfuse4%0%12accepted challenger▲+4Since October 2026: 0% → 4%, +4 points. Inside the 11-point floor: within noise.0% → 4%
Langfuse4%0%12accepted challenger▲+4Since October 2026: 0% → 4%, +4 points. Inside the 11-point floor: within noise.0% → 4%06
Azure API Management4%0%13accepted challenger▲+4Since October 2026: 0% → 4%, +4 points. Inside the 11-point floor: within noise.0% → 4%
Azure API Management4%0%13accepted challenger▲+4Since October 2026: 0% → 4%, +4 points. Inside the 11-point floor: within noise.0% → 4%07
TrueFoundry AI Gateway4%0%13accepted challenger▲+2Since October 2026: 2% → 4%, +2 points. Inside the 11-point floor: within noise.2% → 4%
TrueFoundry AI Gateway4%0%13accepted challenger▲+2Since October 2026: 2% → 4%, +2 points. Inside the 11-point floor: within noise.2% → 4%Show the three products at 0%, ordered by negative rate
09
Helicone0%42%12criticized challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%
Helicone0%42%12criticized challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%10
OpenRouter0%39%23criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
OpenRouter0%39%23criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%08
Cloudflare AI Gateway0%18%34accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Cloudflare AI Gateway0%18%34accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
For buyers
Head to headHead-to-head pages are published for mid-market buyers, so these open on mid-market figures, not enterprise.
All twenty-one head-to-head pages: the top seven products, each against each
LiteLLM vs Cloudflare AI GatewayLiteLLM vs OpenRouterLiteLLM vs LangfusePortkey vs BifrostPortkey vs HeliconePortkey vs Cloudflare AI GatewayPortkey vs OpenRouterPortkey vs LangfuseBifrost vs HeliconeBifrost vs Cloudflare AI GatewayBifrost vs OpenRouterBifrost vs LangfuseHelicone vs Cloudflare AI GatewayHelicone vs OpenRouterHelicone vs LangfuseCloudflare AI Gateway vs OpenRouterCloudflare AI Gateway vs LangfuseOpenRouter vs Langfuse
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01020304050607080910Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative40%
Key
01Bifrost23%
Bifrost23%02LiteLLM18%
LiteLLM18%03Portkey14%
Portkey14%04Kong AI Gateway4%
Kong AI Gateway4%05Langfuse4%
Langfuse4%06Azure API Management4%
Azure API Management4%07TrueFoundry AI Gateway4%
TrueFoundry AI Gateway4%08Cloudflare AI Gateway0%
Cloudflare AI Gateway0%09Helicone0%
Helicone0%10OpenRouter0%
OpenRouter0%What they warned about
Two of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.20, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX, MiniMax M2.5 and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
LiteLLM34%
20 of 58 labels negative · 13 of 14 models · 9 hard negative
“LiteLLM has significant limitations for enterprise use: no formal commercial backing means no enterprise support plan, no SLAs for uptime, and no dedicated escalation path.” Claude Haiku 4.5, negative prompt
OpenRouter39%
9 of 23 labels negative · 6 of 14 models · 3 hard negative
“avoid OpenRouter-like marketplace gateways for regulated or confidential production traffic unless their contractual, residency, isolation, and audit controls satisfy the enterprise's own standards” Perplexity Sonar, negative prompt
Portkey12%
6 of 49 labels negative · 5 of 14 models · 1 hard negative
“Avoid for pure predictability: Fully managed like Portkey” Grok 4.20, budget prompt
Cloudflare AI Gateway18%
6 of 34 labels negative · 4 of 14 models · 1 hard negative
“Avoid for pure predictability: ... Cloudflare, or OpenRouter” Grok 4.20, budget prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
79 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1002 links across 217 sites, every framing counted. Ranked by the number of answers carrying the site or page. 38 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
58 answers · 186 citations · 12 models
43 answers · 69 citations · 11 models
vendor site · GitHub25 answers · 40 citations · 9 models
vendor site · TrueFoundry21 answers · 25 citations · 8 models
vendor site · LLMGateway.io20 answers · 45 citations · 9 models
vendor site · Requesty17 answers · 18 citations · 11 models
vendor site · Portkey14 answers · 26 citations · 9 models
vendor site · LiteLLM14 answers · 21 citations · 7 models
vendor site · Tetrate14 answers · 14 citations · 7 models
13 answers · 25 citations · 8 models
vendor site · LiteLLM12 answers · 22 citations · 8 models
vendor site · WSO211 answers · 18 citations · 8 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
11 answers · 6 models
11 answers · 6 models
11 answers · 8 models
11 answers · 5 models
11 answers · 6 models
10 answers · 7 models
10 answers · 6 models
10 answers · 7 models
10 answers · 5 models
8 answers · 7 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best llm gateway”, “llm gateway”, “llm gateways”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Bifrost getmaxim.ai | 23% | 120 | 12,100 | 427 | 4,289 | 10 | 8 | |
| LiteLLM litellm.ai | 18% | 196 | 22,200 | 264 | 15,281 | 0 | 2 | |
| Portkey portkey.ai | 14% | 156 | 5,400 | 131 | 5,999 | 0 | 5 | |
| FastRouter fastrouter.ai | 7% | 11 | ||||||
| Azure parent site Azure API Management 4%, Azure AI Gateway 2% | 5% | 275 | 301,000 | 47,904 | ||||
| Kong konghq.com Kong AI Gateway 4% | 4% | 85 | 880 | 10 | 20,236 company | $376 | 62 | |
| Langfuse langfuse.com | 4% | 48 | 18,100 | 216 | 8,530 | 4 | ||
| TrueFoundry AI Gateway truefoundry.com | 4% | 24 | 47,088 | 2 | 3 | |||
| Orq.ai orq.ai | 4% | 6 | 2 | |||||
| Confident AI confident-ai.com | 4% | 10 |
Google's top ten for the three searches hold 18 sites; 7 of them are among the sites the models cited here (dev.to, getmaxim.ai, github.com, litellm.ai, llmgateway.io, portkey.ai, truefoundry.com). The first result for “best llm gateway” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best LLM gateway for an enterprise B2B company?”Paraphrase“Which LLM observability and routing platform would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade LLM gateways and how do they differ?”Budget-constrained“What is the best LLM gateway for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a LLM gateway. What should we look at?”Negative“Which LLM gateways should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5BifrostTrueFoundry AI GatewayChangedBifrostKong AI Gateway, LiteLLMno first choiceagainst: Helicone, LiteLLM
Three alternatives
Kong AI Gateway, Portkey, TrueFoundry AI GatewayThree alternatives
Datadog LLM Observability, Langfuse, PortkeyFour alternatives
Cloudflare AI Gateway, Kong AI Gateway, LiteLLM, TrueFoundry AI GatewayOne alternative
BifrostGPT-5.4 miniAWS Bedrock AgentCore Gateway, Azure AI Gateway, Azure API Management, LiteLLMLangSmithChangedno first choiceOpenAILiteLLMnothing named
Three alternatives
Arize AX, Helicone, PortkeyFive alternatives
Amazon Bedrock, Azure AI Gateway, Kong AI Gateway, LiteLLM, OpenRouterTwo alternatives
ChatGPT, Scale TierGemini 3.5 FlashLiteLLMPortkeyChangedagainst: Datadog LLM ObservabilityPortkeyLiteLLM, Portkeyno first choiceagainst: Bifrost, Cequence, Cloudflare AI Gateway, Envoy, LiteLLM, MLflow AI Gateway, NGINX, Portkey
Five alternatives
Bifrost, Kong AI Gateway, Lunar.dev, NeuralTrust TrustGate, PortkeyFive alternatives
Arize AI, Braintrust Gateway, LangSmith, Langfuse, LiteLLMFour alternatives
Bifrost, Cloudflare AI Gateway, Kong AI Gateway, LiteLLMTwo alternatives
Cloudflare AI Gateway, Kong AI GatewayPerplexity SonarTrueFoundry AI GatewayPortkeyChangedBifrost, LiteLLMagainst: OpenRouterBifrostno first choiceagainst: Cloudflare AI Gateway, Kong AI Gateway, LiteLLM, OpenRouter, Vercel
Four alternatives
Bifrost, Kong AI Gateway, LiteLLM, PortkeyFour alternatives
Bifrost, Datadog LLM Observability, Langfuse, Orq.aiFour alternatives
Cloudflare AI Gateway, Kong AI Gateway, Portkey, TrueFoundry AI GatewayThree alternatives
LiteLLM, Portkey, TrueFoundry AI GatewayGrok 4.20Azure API Management, Kong AI Gatewayagainst: Bifrost, Cloudflare AI Gateway, LiteLLMOrq.aiChangedagainst: Arize Phoenix, Braintrust GatewayBifrost, Portkeyagainst: OpenRouterBifrostagainst: Cloudflare AI Gateway, OpenRouter, Portkeyno first choiceagainst: Cloudflare AI Gateway, LiteLLM, OpenRouter, Portkey, Vercel AI SDK/Gateway
One alternative
PortkeySeven alternatives
Datadog LLM Observability, Dynatrace, Helicone, LangSmith, Langfuse, LiteLLM, PortkeyFour alternatives
Azure API Management, Cloudflare AI Gateway, Kong AI Gateway, LiteLLMTwo alternatives
Kong AI Gateway, LiteLLMMistral SmallBifrostBifrostHeldMixRouteBifrost, FastRouterno first choiceagainst: LiteLLM
Four alternatives
MixRoute, OpenRouter, Portkey, RequestyTwo alternatives
Bifrost, Cloudflare AI GatewayOne alternative
PortkeyDeepSeek V4 FlashBifrostagainst: LiteLLMPortkeyChangedagainst: LangSmithLiteLLMBifrostLiteLLMagainst: Cloudflare AI Gateway, LiteLLM, OpenRouter, Portkey, Vercel AI Gateway
Three alternatives
Cloudflare AI Gateway, Kong AI Gateway, PortkeyTwo alternatives
Datadog Agent Observability, LangfuseSix alternatives
Azure API Management, Bifrost, Cloudflare AI Gateway, Kong AI Gateway, Portkey, WSO2 AI GatewayThree alternatives
Kong AI Gateway, LiteLLM, PortkeyThree alternatives
Aptible LLM Gateway, LLM Gateway, ZuploLlama 4 Maverickno first choiceConfident AIChangedno first choiceFastRouterno first choiceagainst: LiteLLM, OpenRouter
Five alternatives
Bifrost, Concentrate, MixRoute, OpenRouter, RequestyQwen 3.7 FlashBifrostagainst: LiteLLMDatadog LLM ObservabilityChangedBifrost, Tetrate Agent Router EnterpriseBifrostno first choiceagainst: LiteLLM
Three alternatives
Azure API Management, Kong AI Gateway, PortkeyTwo alternatives
Dynatrace, Kong AI GatewayThree alternatives
Cloudflare AI Gateway, Kong AI Gateway, LiteLLMThree alternatives
Apache APISIX, Kong AI Gateway, LiteLLMKimi K2Bifrostagainst: LiteLLMLangfuseChangedBifrostagainst: HeliconeLiteLLMLiteLLMagainst: Helicone, LiteLLM, Portkey, Promptfoo
Four alternatives
Cloudflare AI Gateway, Kong AI Gateway, Portkey, TrueFoundry AI GatewayFour alternatives
Bifrost, Braintrust Gateway, Datadog LLM Observability, Weights & Biases WeaveFour alternatives
Cloudflare AI Gateway, Kong AI Gateway, LiteLLM, PortkeyOne alternative
Cloudflare AI GatewaySix alternatives
AWS, Azure API Management, Bifrost, Cloudflare AI Gateway, Kong AI Gateway, PortkeyGLM 4.7 FlashXBifrostagainst: LiteLLMConfident AI, Tyk AI GatewayChangedBifrostagainst: OpenRouterLiteLLM, Requestyno first choiceagainst: Helicone, LLMGateway.io, LiteLLM
Two alternatives
Kong AI Gateway, PortkeyFour alternatives
Arize AI, Datadog LLM Observability, Langfuse, Maxim AITen alternatives
Cloudflare AI Gateway, Helicone, Kong AI Gateway, LiteLLM, SAP Enterprise AI Gateway, ServiceNow AI Gateway, Snowflake Cortex AI Gateway, Tyk AI Gateway, Vercel AI Gateway, WSO2 AI GatewayTwo alternatives
Bifrost, LLM GatewayMiniMax M2.5Bifrostagainst: LiteLLMLangfuseChangedBifrostagainst: LiteLLMFastRouter, LLM Gatewayno first choiceagainst: Braintrust Gateway, LiteLLM
One alternative
Portkey AI GatewayFive alternatives
Arize AI, Arize Phoenix, Bifrost, Datadog LLM Observability, PortkeyFive alternatives
Azure API Management, Cloudflare AI Gateway, Kong AI Gateway, Portkey, WSO2 AI GatewayOne alternative
PortkeyGPT-6 LunaPortkeyPortkeyHeldLiteLLMLiteLLMno first choiceagainst: LiteLLM
Two alternatives
Kong AI Gateway, LiteLLMOne alternative
LangfuseFive alternatives
Azure API Management AI gateway, Cloudflare AI Gateway, Envoy AI Gateway, Kong AI Gateway, PortkeyOne alternative
PortkeyMuse Glimmer 30BFastRouter, Future AGI Agent Command CenterOrq.ai, PortkeyChangedBifrostPortkeyno first choiceagainst: Helicone, LiteLLM, OpenRouter, Portkey
Seven alternatives
Bifrost, Concentrate, LiteLLM, OpenRouter, Portkey, Requesty, TrueFoundry AI GatewayThree alternatives
Arize Phoenix, Bifrost, LangfuseEight alternatives
Cloudflare AI Gateway, FastRouter, Kong AI Gateway, LiteLLM, OpenRouter, Portkey, Tetrate Agent Router Enterprise, Vercel AI GatewayThree alternatives
Bifrost, Concentrate, LiteLLMBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 18:54 | yes | 9 | 8 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 15:35 | yes | 4 | 6 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 19:42 | yes | 12 | 29 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 13:46 | yes | 10 | 4 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 16:47 | yes | 14 | 15 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 19:26 | yes | 5 | 6 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 17:15 | yes | 24 | 36 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 16:15 | yes | 5 | 3 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 12:23 | yes | 5 | 24 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 08:51 | yes | 10 | 19 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 16:27 | yes | 14 | 26 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 18:02 | yes | 5 | 27 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 18:50 | yes | 4 | 16 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 13:14 | yes | 14 | 32 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 09:32 | yes | 18 | 9 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 13:10 | yes | 3 | 6 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 14:24 | no | 0 | 15 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 12:23 | yes | 10 | 4 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:33 | yes | 5 | 10 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 13:46 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 19:38 | yes | 25 | 27 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 08:48 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 13:34 | yes | 23 | 136 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 17:40 | yes | 25 | 38 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 09:36 | yes | 14 | 18 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 09:59 | yes | 5 | 30 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 11:50 | yes | 4 | 18 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 09:53 | yes | 14 | 27 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 13:23 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 13:03 | yes | 6 | 9 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 19:29 | yes | 11 | 25 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 11:47 | yes | 10 | 6 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:43 | yes | 15 | 20 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 09:19 | yes | 5 | 8 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:31 | yes | 22 | 31 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 08:59 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:31 | yes | 5 | 16 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 15:51 | yes | 18 | 40 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 13:23 | yes | 25 | 69 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 18:10 | yes | 25 | 75 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 16:35 | yes | 6 | 36 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 11:23 | yes | 15 | 27 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 15:04 | yes | 18 | 11 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 14:29 | yes | 4 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 10:57 | no | 0 | 16 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 14:38 | yes | 10 | 3 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 18:47 | yes | 13 | 14 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 16:22 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 09:18 | yes | 24 | 32 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 12:27 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 18:54 | yes | 10 | 36 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 09:44 | yes | 24 | 85 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 12:14 | yes | 24 | 66 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 09:41 | yes | 21 | 76 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 13:09 | yes | 2 | 13 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 17:57 | yes | 19 | 35 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:00 | yes | 18 | 15 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 17:55 | yes | 6 | 12 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 11:29 | no | 0 | 17 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 16:29 | yes | 10 | 9 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:35 | yes | 15 | 17 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 08:53 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 17:24 | yes | 24 | 64 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 10:27 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 18:32 | yes | 15 | 42 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 17:28 | yes | 14 | 66 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 15:04 | yes | 22 | 37 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 16:40 | no | 0 | 23 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 18:12 | yes | 2 | 33 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 11:13 | yes | 14 | 18 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 14:35 | yes | 18 | 11 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 16:08 | yes | 4 | 8 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 08:59 | yes | 11 | 26 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 15:29 | yes | 10 | 5 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 14:01 | yes | 14 | 17 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 13:31 | yes | 10 | 9 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 17:42 | yes | 24 | 41 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 12:56 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:32 | yes | 14 | 51 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 18:26 | yes | 25 | 51 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:36 | yes | 25 | 44 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 11:22 | yes | 23 | 83 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 19:12 | yes | 3 | 20 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 13:42 | yes | 24 | 33 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Azure OpenAI read as Azure OpenAI Service
Braintrust read as Braintrust Gateway
Cloudflare read as Cloudflare AI Gateway
Datadog read as Datadog LLM Observability
Kong read as Kong AI Gateway
Kong (Kong AI Gateway) read as Kong AI Gateway
LLM Gateway.io read as LLM Gateway
NeuralTrust (TrustGate) read as NeuralTrust TrustGate
Portkey.ai read as Portkey
TrueFoundry read as TrueFoundry AI Gateway
Unresolved, counted raw
AWS Bedrock AgentCore Gateway
AWS-native solutions
Anthropic-style gateways
Aptible LLM Gateway
Azure API Management AI gateway
Datadog Agent Observability
FloTorch Gateway
LUMI
Lunar.dev
Manifest
Privacy Router
SAP Enterprise AI Gateway
Scale Tier
ServiceNow AI Gateway
Snowflake Cortex AI Gateway
Weights & Biases W&B Weave
Weights & Biases Weave
Discontinued, still offered
No shut-down product was recommended here.