# LLM gateways and observability for enterprise buyers: what AI models recommend, November 2026

Gane Index, November 2026 Edition. Asked as "LLM gateway" and as "LLM observability and routing platform", six framings each, to fourteen models with search on, on behalf of an enterprise B2B company. Page: https://www.gane.ai/index/it/it-data/llm-gateways-and-observability/2026-11/enterprise

**Standing:** Bifrost leads with 23% of first choices; verdict contested. 56 first choices across the direct, paraphrase, budget and scale prompts.

## First-choice share

| Rank | Product | Share | Negative rate | Labels |
|---|---|---|---|---|
| 1 | [Bifrost](https://www.gane.ai/index/it/vendors/bifrost/index.md) | 23% | 4% | 46 |
| 2 | [LiteLLM](https://www.gane.ai/index/it/vendors/litellm/index.md) | 18% | 34% | 58 |
| 3 | [Portkey](https://www.gane.ai/index/it/vendors/portkey/index.md) | 14% | 12% | 49 |
| 5 | [Kong AI Gateway](https://www.gane.ai/index/it/vendors/kong-ai-gateway/index.md) | 4% | 2% | 47 |
| 6 | [Langfuse](https://www.gane.ai/index/it/vendors/langfuse/index.md) | 4% | 0% | 12 |
| 7 | [Azure API Management](https://www.gane.ai/index/it/vendors/azure-api-management/index.md) | 4% | 0% | 13 |
| 8 | [TrueFoundry AI Gateway](https://www.gane.ai/index/it/vendors/truefoundry-ai-gateway/index.md) | 4% | 0% | 13 |
| 20 | [Cloudflare AI Gateway](https://www.gane.ai/index/it/vendors/cloudflare-ai-gateway/index.md) | 0% | 18% | 34 |
| 74 | [Helicone](https://www.gane.ai/index/it/vendors/helicone/index.md) | 0% | 42% | 12 |
| 81 | [OpenRouter](https://www.gane.ai/index/it/vendors/openrouter/index.md) | 0% | 39% | 23 |

Rank is by share of first choices among all 82 products named; products with the same share are tied, and the order among them carries no meaning. The table lists those with at least 10 labels.

## Each model's first choice on the direct prompt

- Claude Haiku 4.5: Bifrost; alternatives Kong AI Gateway, Portkey, TrueFoundry AI Gateway
- GPT-5.4 mini: AWS Bedrock AgentCore Gateway, Azure AI Gateway, Azure API Management, LiteLLM
- Gemini 3.5 Flash: LiteLLM; alternatives Bifrost, Kong AI Gateway, Lunar.dev, NeuralTrust TrustGate
- Perplexity Sonar: TrueFoundry AI Gateway; alternatives Bifrost, Kong AI Gateway, LiteLLM, Portkey
- Grok 4.20: Azure API Management, Kong AI Gateway; alternatives Portkey
- Mistral Small: Bifrost; alternatives MixRoute, OpenRouter, Portkey, Requesty
- DeepSeek V4 Flash: Bifrost; alternatives Cloudflare AI Gateway, Kong AI Gateway, Portkey
- Llama 4 Maverick: no first choice; alternatives Bifrost, Concentrate, MixRoute, OpenRouter
- Qwen 3.7 Flash: Bifrost; alternatives Azure API Management, Kong AI Gateway, Portkey
- Kimi K2: Bifrost; alternatives Cloudflare AI Gateway, Kong AI Gateway, Portkey, TrueFoundry AI Gateway
- GLM 4.7 FlashX: Bifrost; alternatives Kong AI Gateway, Portkey
- MiniMax M2.5: Bifrost; alternatives Portkey AI Gateway
- GPT-6 Luna: Portkey; alternatives Kong AI Gateway, LiteLLM
- Muse Glimmer 30B: FastRouter, Future AGI Agent Command Center; alternatives Bifrost, Concentrate, LiteLLM, OpenRouter

## Sources the answers cite

79 of 84 answers came back with a source list, from 14 of 14 models. Sites named in the most answers:

- getmaxim.ai: 58 answers, 186 citations
- dev.to: 43 answers, 69 citations
- github.com: 25 answers, 40 citations
- truefoundry.com: 21 answers, 25 citations
- llmgateway.io: 20 answers, 45 citations
- requesty.ai: 17 answers, 18 citations
- portkey.ai: 14 answers, 26 citations
- litellm.ai: 14 answers, 21 citations

Pages named in the most answers:

- https://concentrate.ai/blog/the-9-best-llm-gateways-in-2026-grouped-by-the-job-they-do (11 answers)
- https://dev.to/anthonymax/best-enterprise-ai-gateways-33pp (11 answers)
- https://dev.to/ericthompson21/when-is-a-managed-llm-gateway-worth-its-cost-5959 (11 answers)
- https://dev.to/toffy/top-5-llm-gateways-for-enterprises-26hg (11 answers)
- https://llmgateway.io/ (11 answers)
- https://getmaxim.ai/articles/best-enterprise-llm-gateways-in-2026-a-comparative-guide (10 answers)
- https://llmgateway.io/enterprise (10 answers)
- https://requesty.ai/blog/best-managed-llm-gateway (10 answers)
- https://tetrate.io/learn/ai/best-enterprise-ai-gateway (10 answers)
- https://flotorch.ai/blogs/llm-gateway-comparison-2026 (8 answers)

## Warned against

- LiteLLM: 20 of 58 labels negative. "LiteLLM has significant limitations for enterprise use: no formal commercial backing means no enterprise support plan, no SLAs for uptime, and no dedicated escalation path." (Claude Haiku 4.5, negative prompt)
- OpenRouter: 9 of 23 labels negative. "avoid OpenRouter-like marketplace gateways for regulated or confidential production traffic unless their contractual, residency, isolation, and audit controls satisfy the enterprise's own standards" (Perplexity Sonar, negative prompt)
- Portkey: 6 of 49 labels negative. "Avoid for pure predictability: Fully managed like Portkey" (Grok 4.20, budget prompt)
- Cloudflare AI Gateway: 6 of 34 labels negative. "Avoid for pure predictability: ... Cloudflare, or OpenRouter" (Grok 4.20, budget prompt)

## Movement since October 2026

Floor: 11 points of share, measured on the calibration repeat.
New leader: Portkey (26%) to Bifrost (23%). Margin 9 points, within noise.

- Portkey: 26% to 14%, −12. Cleared the floor by 1 point · rank 1 → 3 of 82.
- Bifrost: 15% to 23%, +8. Inside the floor by 3 points · rank 3 → 1 of 82.
- LiteLLM: 26% to 18%, −8. Inside the floor by 3 points · rank 2 of 82, unchanged.
- Langfuse: 0% to 4%, +4. Inside the floor by 7 points · rank 19 → 6 of 82.
- Azure API Management: 0% to 4%, +4. Inside the floor by 7 points · rank 25 → 7 of 82.
- Kong AI Gateway: 6% to 4%, −2. Inside the floor by 9 points · rank 4 → 5 of 82.
- TrueFoundry AI Gateway: 2% to 4%, +2. Inside the floor by 9 points · rank 9 → 8 of 82.
- Tetrate Agent Router Enterprise: 2% to 0%, −2. Inside the floor by 9 points · rank 10 → 21 of 82.
- Helicone: 2% to 0%, −2. Inside the floor by 9 points · rank 8 → 74 of 82.
- Cloudflare AI Gateway: 0% to 0%, ±0. Inside the floor by 11 points · rank 17 → 20 of 82.
- OpenRouter: 0% to 0%, ±0. Inside the floor by 11 points · rank 86 → 81 of 82.

## Record

- Method: https://www.gane.ai/index/it/methodology
- License: CC BY 4.0. Cite as Gane Index, November 2026 Edition, www.gane.ai/index/it.