# LLM gateways and observability for enterprise buyers: what AI models recommend, October 2026

Gane Index, October 2026 Edition. Asked as "LLM gateway" and as "LLM observability and routing platform", six framings each, to fourteen models with search on, on behalf of an enterprise B2B company. Page: https://www.gane.ai/index/it/it-data/llm-gateways-and-observability/2026-10/enterprise

This is the permanent record of the October 2026 Edition, published October 1, 2026 and superseded since. The current standing: https://www.gane.ai/index/it/it-data/llm-gateways-and-observability/enterprise/index.md

**Standing:** Portkey (tied with LiteLLM) leads with 26% of first choices; verdict contested. 54 first choices across the direct, paraphrase, budget and scale prompts.

## First-choice share

| Rank | Product | Share | Negative rate | Labels |
|---|---|---|---|---|
| 1 | [Portkey](https://www.gane.ai/index/it/vendors/portkey/index.md) | 26% | 13% | 52 |
| 2 | [LiteLLM](https://www.gane.ai/index/it/vendors/litellm/index.md) | 26% | 19% | 59 |
| 3 | [Bifrost](https://www.gane.ai/index/it/vendors/bifrost/index.md) | 15% | 3% | 31 |
| 4 | [Kong AI Gateway](https://www.gane.ai/index/it/vendors/kong-ai-gateway/index.md) | 6% | 8% | 39 |
| 8 | [Helicone](https://www.gane.ai/index/it/vendors/helicone/index.md) | 2% | 11% | 19 |
| 9 | [TrueFoundry AI Gateway](https://www.gane.ai/index/it/vendors/truefoundry-ai-gateway/index.md) | 2% | 0% | 11 |
| 10 | [Tetrate Agent Router Enterprise](https://www.gane.ai/index/it/vendors/tetrate-agent-router-enterprise/index.md) | 2% | 0% | 10 |
| 17 | [Cloudflare AI Gateway](https://www.gane.ai/index/it/vendors/cloudflare-ai-gateway/index.md) | 0% | 21% | 19 |
| 86 | [OpenRouter](https://www.gane.ai/index/it/vendors/openrouter/index.md) | 0% | 53% | 30 |

Rank is by share of first choices among all 86 products named; products with the same share are tied, and the order among them carries no meaning. The table lists those with at least 10 labels.

## Each model's first choice on the direct prompt

- Claude Haiku 4.5: Bifrost, Portkey; alternatives TrueFoundry AI Gateway
- GPT-5.4 mini: Kong AI Gateway, LiteLLM; alternatives OpenRouter
- Gemini 3.5 Flash: LiteLLM; alternatives Bifrost, Cloudflare AI Gateway, Kong AI Gateway, Portkey
- Perplexity Sonar: Bifrost; alternatives Helicone, Inworld Router, Kong AI Gateway, LiteLLM
- Grok 4.20: Portkey; alternatives Bifrost, Cloudflare AI Gateway, Kong AI Gateway, LiteLLM
- Mistral Small: Tetrate Agent Router Enterprise; alternatives Bifrost, Cloudflare AI Gateway
- DeepSeek V4 Flash: Portkey; alternatives Bifrost, Kong AI Gateway, Tetrate Agent Router Enterprise
- Llama 4 Maverick: Bifrost; alternatives Cloudflare AI Gateway, Kong AI Gateway, Tetrate Agent Router Enterprise
- Qwen 3.7 Flash: Kong AI Gateway, Portkey; alternatives Bifrost, LiteLLM
- Kimi K2: Portkey; alternatives Azure API Management with AI Gateway, Kong AI Gateway, LiteLLM, TrueFoundry Gateway
- GLM 4.7 FlashX: Portkey; alternatives Kong AI Gateway, LiteLLM
- MiniMax M2.5: Bifrost, LLM Gateway; alternatives Cloudflare AI Gateway, Kong AI Gateway, LiteLLM
- GPT-6 Luna: LiteLLM; alternatives Kong AI Gateway
- Muse Glimmer 30B: Kong AI Gateway, Portkey AI Gateway; alternatives Bifrost, LiteLLM, Requesty, Tetrate Agent Router Enterprise

## Sources the answers cite

76 of 84 answers came back with a source list, from 14 of 14 models. Sites named in the most answers:

- getmaxim.ai: 52 answers, 166 citations
- truefoundry.com: 37 answers, 56 citations
- openrouter.ai: 29 answers, 33 citations
- dev.to: 27 answers, 44 citations
- llmgateway.io: 24 answers, 55 citations
- portkey.ai: 21 answers, 40 citations
- respan.ai: 19 answers, 19 citations
- docs.litellm.ai: 18 answers, 25 citations

Pages named in the most answers:

- https://openrouter.ai/blog/insights/llm-gateway (27 answers)
- https://getmaxim.ai/articles/top-5-llm-gateways-in-2026-a-production-ready-comparison (21 answers)
- https://getmaxim.ai/articles/top-5-enterprise-llm-gateways-for-secured-and-governed-ai (19 answers)
- https://getmaxim.ai/articles/best-enterprise-llm-gateways-in-2026-a-comparative-guide (17 answers)
- https://respan.ai/articles/best-llm-gateways (16 answers)
- https://tetrate.io/learn/ai/best-enterprise-ai-gateway (16 answers)
- https://cloudzero.com/blog/llm-gateways (14 answers)
- https://dataiku.com/blog/best-llm-gateways (12 answers)
- https://docs.litellm.ai/docs/enterprise (12 answers)
- https://llmgateway.io/ (12 answers)

## Warned against

- LiteLLM: 11 of 59 labels negative. "LiteLLM, the most widely deployed open-source LLM gateway, had 8 official GitHub Security Advisories published in a single calendar year, including three rated Critical, and a supply-chain incident" (Claude Haiku 4.5, negative prompt)
- OpenRouter: 16 of 30 labels negative. "OpenRouter-type managed routers are faster to start but are a markup model ... That is the opposite of predictable total cost for a large company." (Muse Glimmer 30B, budget prompt)
- Portkey: 7 of 52 labels negative. "Portkey: It is not suitable for customer-facing applications at scale, real-time features where every millisecond counts, or production workloads requiring 99.9%+ uptime." (Llama 4 Maverick, negative prompt)
- Cloudflare AI Gateway: 4 of 19 labels negative. "I'd evaluate it carefully against your requirements for deployment control and enterprise governance before making it the central policy layer." (GPT-6 Luna, direct prompt)

## Movement since September 2026

Floor: 11 points of share, measured on the calibration repeat.
New leader: LiteLLM (29%) to Portkey (32%). Margin 9 points, within noise.

- Portkey: 15% to 32%, +17. Cleared the floor by 6 points · rank 3 → 1 of 74.
- Bifrost: 27% to 16%, −11. Cleared the floor by 0 points · rank 2 → 3 of 74.
- LiteLLM: 29% to 23%, −6. Inside the floor by 5 points · rank 1 → 2 of 74.
- Langfuse: 4% to 0%, −4. Inside the floor by 7 points · rank 6 → 16 of 74.
- Braintrust Gateway: 4% to 0%, −4. Inside the floor by 7 points · rank 4 → 45 of 74.
- Kong AI Gateway: 2% to 5%, +3. Inside the floor by 8 points · rank 8 → 4 of 74.
- TrueFoundry AI Gateway: 4% to 2%, −2. Inside the floor by 9 points · rank 5 → 6 of 74.
- Cloudflare AI Gateway: 2% to 0%, −2. Inside the floor by 9 points · rank 9 → 15 of 74.
- OpenRouter: 2% to 0%, −2. Inside the floor by 9 points · rank 13 → 74 of 74.
- Helicone: 2% to 2%, ±0. Inside the floor by 11 points · rank 10 → 7 of 74.
- NeuralTrust TrustGate: 0% to 0%, ±0. Inside the floor by 11 points · rank 14 → 35 of 74.

## Record

- Method: https://www.gane.ai/index/it/methodology
- License: CC BY 4.0. Cite as Gane Index, October 2026 Edition, www.gane.ai/index/it.