# LLM gateways and observability: what AI models recommend, September 2026

Gane Index, September 2026 Edition. Asked as "LLM gateway" and as "LLM observability and routing platform", six framings each, to twelve models with search on, on behalf of a mid-market B2B company. Page: https://www.gane.ai/index/it/it-data/llm-gateways-and-observability/2026-09

This is the permanent record of the September 2026 Edition, published September 17, 2026 and superseded since. The current standing: https://www.gane.ai/index/it/it-data/llm-gateways-and-observability/index.md

**Standing:** LiteLLM leads with 38% of first choices; verdict contested. 45 first choices across the direct, paraphrase, budget and scale prompts.

## First-choice share

| Rank | Product | Share | Negative rate | Labels |
|---|---|---|---|---|
| 1 | [LiteLLM](https://www.gane.ai/index/it/vendors/litellm/index.md) | 38% | 18% | 51 |
| 2 | [Portkey](https://www.gane.ai/index/it/vendors/portkey/index.md) | 29% | 2% | 44 |
| 3 | [Helicone](https://www.gane.ai/index/it/vendors/helicone/index.md) | 9% | 13% | 30 |
| 4 | [Langfuse](https://www.gane.ai/index/it/vendors/langfuse/index.md) | 9% | 0% | 11 |
| 5 | [Braintrust Gateway](https://www.gane.ai/index/it/vendors/braintrust-gateway/index.md) | 4% | 0% | 17 |
| 6 | [Cloudflare AI Gateway](https://www.gane.ai/index/it/vendors/cloudflare-ai-gateway/index.md) | 2% | 4% | 25 |
| 7 | [OpenRouter](https://www.gane.ai/index/it/vendors/openrouter/index.md) | 2% | 23% | 31 |
| 8 | [Kong AI Gateway](https://www.gane.ai/index/it/vendors/kong-ai-gateway/index.md) | 2% | 17% | 18 |
| 11 | [Bifrost](https://www.gane.ai/index/it/vendors/bifrost/index.md) | 0% | 0% | 21 |

Rank is by share of first choices among all 59 products named; products with the same share are tied, and the order among them carries no meaning. The table lists those with at least 10 labels.

## Each model's first choice on the direct prompt

- Claude Haiku 4.5: Portkey; alternatives LiteLLM, OpenRouter
- GPT-5.4 mini: Portkey; alternatives Kong AI Gateway, LiteLLM
- Gemini 3.5 Flash: LiteLLM; alternatives Bifrost, Cloudflare AI Gateway, Portkey, TrueFoundry AI Gateway
- Perplexity Sonar: LiteLLM, Portkey; alternatives Bifrost, Cloudflare AI Gateway, Kong AI Gateway
- Grok 4.20: Portkey; alternatives LiteLLM
- Mistral Small: Helicone, LiteLLM; alternatives Braintrust Gateway, OpenRouter
- DeepSeek V4 Flash: LiteLLM; alternatives Cloudflare AI Gateway, Portkey
- Llama 4 Maverick: no first choice
- Qwen 3.7 Flash: Portkey; alternatives Bifrost, Cloudflare AI Gateway, LiteLLM
- Kimi K2: LiteLLM; alternatives Helicone, Portkey, Requesty
- GLM 4.7 FlashX: Portkey; alternatives Helicone, LiteLLM
- MiniMax M2.5: Merge Gateway, Portkey; alternatives LiteLLM

## Sources the answers cite

65 of 72 answers came back with a source list, from 12 of 12 models. Sites named in the most answers:

- getmaxim.ai: 31 answers, 58 citations
- braintrust.dev: 29 answers, 39 citations
- respan.ai: 29 answers, 35 citations
- dev.to: 27 answers, 48 citations
- cloudzero.com: 27 answers, 27 citations
- orq.ai: 22 answers, 24 citations
- dataiku.com: 21 answers, 24 citations
- truefoundry.com: 19 answers, 29 citations

Pages named in the most answers:

- https://cloudzero.com/blog/llm-gateways (27 answers)
- https://respan.ai/articles/best-llm-gateways (23 answers)
- https://orq.ai/blog/best-llm-gateways (22 answers)
- https://dataiku.com/blog/best-llm-gateways (21 answers)
- https://techsy.io/en/blog/best-llm-gateway-tools (19 answers)
- https://braintrust.dev/articles/best-llm-gateways-2026 (14 answers)
- https://contabo.com/blog/best-llm-gateways (11 answers)
- https://dev.to/varshithvhegde/top-5-llm-gateways-in-2026-a-deep-dive-comparison-for-production-teams-34d2 (11 answers)
- https://opper.ai/blog/best-llm-gateways (11 answers)
- https://getmaxim.ai/articles/best-enterprise-llm-gateways-in-2026-a-comparative-guide (9 answers)

## Warned against

- LiteLLM: 9 of 51 labels negative. "Be cautious with self-hosted or open-source LLM gateways like LiteLLM and Ollama, especially if internet-exposed, due to documented security risks... actively exploited and CISA KEV-listed" (Grok 4.20, negative prompt)
- OpenRouter: 7 of 31 labels negative. "routing sensitive enterprise or user data through a third-party hosted cloud gateway introduces strict compliance and privacy risks" (Gemini 3.5 Flash, negative prompt)
- Helicone: 4 of 30 labels negative. "Avoid depending on Helicone — it's now in maintenance mode" (DeepSeek V4 Flash, budget prompt)
- Kong AI Gateway: 3 of 18 labels negative. "the operational weight is hard to justify for LLM routing alone if you're not already a Kong shop" (Claude Haiku 4.5, comparative prompt)

## Record

- Method: https://www.gane.ai/index/it/methodology
- License: CC BY 4.0. Cite as Gane Index, September 2026 Edition, www.gane.ai/index/it.