# LLM gateways and observability for small business buyers: what AI models recommend, September 2026

Gane Index, September 2026 Edition. Asked as "LLM gateway" and as "LLM observability and routing platform", six framings each, to twelve models with search on, on behalf of a small B2B company. Page: https://www.gane.ai/index/it/it-data/llm-gateways-and-observability/2026-09/smb

This is the permanent record of the September 2026 Edition, published September 17, 2026 and superseded since. The current standing: https://www.gane.ai/index/it/it-data/llm-gateways-and-observability/smb/index.md

**Standing:** LiteLLM leads with 46% of first choices; verdict clear leader. 52 first choices across the direct, paraphrase, budget and scale prompts.

## First-choice share

| Rank | Product | Share | Negative rate | Labels |
|---|---|---|---|---|
| 1 | [LiteLLM](https://www.gane.ai/index/it/vendors/litellm/index.md) | 46% | 14% | 57 |
| 2 | [Portkey](https://www.gane.ai/index/it/vendors/portkey/index.md) | 15% | 8% | 49 |
| 3 | [OpenRouter](https://www.gane.ai/index/it/vendors/openrouter/index.md) | 10% | 9% | 43 |
| 4 | [Helicone](https://www.gane.ai/index/it/vendors/helicone/index.md) | 10% | 22% | 36 |
| 6 | [Cloudflare AI Gateway](https://www.gane.ai/index/it/vendors/cloudflare-ai-gateway/index.md) | 4% | 7% | 27 |
| 10 | [Bifrost](https://www.gane.ai/index/it/vendors/bifrost/index.md) | 0% | 15% | 13 |

Rank is by share of first choices among all 43 products named; products with the same share are tied, and the order among them carries no meaning. The table lists those with at least 10 labels.

## Each model's first choice on the direct prompt

- Claude Haiku 4.5: OpenRouter; alternatives Braintrust Gateway, Helicone, LiteLLM
- GPT-5.4 mini: LiteLLM; alternatives OpenRouter, Portkey
- Gemini 3.5 Flash: Portkey; alternatives Bifrost, Cloudflare AI Gateway, LiteLLM, OpenRouter
- Perplexity Sonar: LiteLLM; alternatives Bifrost, Cloudflare AI Gateway, OpenRouter, Portkey
- Grok 4.20: LiteLLM, OpenRouter; alternatives Portkey
- Mistral Small: Helicone, LiteLLM; alternatives Cloudflare AI Gateway
- DeepSeek V4 Flash: LiteLLM, Portkey; alternatives Cloudflare AI Gateway, OpenRouter
- Llama 4 Maverick: Helicone, LiteLLM
- Qwen 3.7 Flash: LiteLLM; alternatives OpenRouter, Portkey
- Kimi K2: LiteLLM, Portkey
- GLM 4.7 FlashX: LiteLLM; alternatives Portkey
- MiniMax M2.5: Helicone; alternatives LiteLLM, OpenRouter

## Sources the answers cite

66 of 72 answers came back with a source list, from 12 of 12 models. Sites named in the most answers:

- truefoundry.com: 39 answers, 54 citations
- braintrust.dev: 33 answers, 45 citations
- dev.to: 31 answers, 47 citations
- orq.ai: 31 answers, 33 citations
- getmaxim.ai: 29 answers, 52 citations
- respan.ai: 29 answers, 31 citations
- dataiku.com: 27 answers, 27 citations
- techsy.io: 27 answers, 27 citations

Pages named in the most answers:

- https://orq.ai/blog/best-llm-gateways (29 answers)
- https://dataiku.com/blog/best-llm-gateways (27 answers)
- https://techsy.io/en/blog/best-llm-gateway-tools (27 answers)
- https://respan.ai/articles/best-llm-gateways (26 answers)
- https://truefoundry.com/blog/best-llm-gateways (25 answers)
- https://cloudzero.com/blog/llm-gateways (24 answers)
- https://braintrust.dev/articles/best-llm-gateways-2026 (20 answers)
- https://contabo.com/blog/best-llm-gateways (19 answers)
- https://dev.to/debmckinney/we-evaluated-13-llm-gateways-for-production-heres-what-we-found-2dkm (14 answers)
- https://beri.net/article/best-llm-gateways-multi-provider-cost-control-2026 (11 answers)

## Warned against

- LiteLLM: 8 of 57 labels negative. "hundreds of publicly exposed LiteLLM servers (a popular open-source AI gateway) were accepting the default master key (`sk-1234`) or required no authentication at all" (Kimi K2, negative prompt)
- Helicone: 8 of 36 labels negative. "Acquired by Mintlify (2026); in maintenance mode with no new features/updates ... not future-proof for production." (Grok 4.20, negative prompt)
- OpenRouter: 4 of 43 labels negative. "No uptime SLA; auto-routing/fallbacks can silently send data to non-compliant providers ... risking data residency/GDPR issues" (Grok 4.20, negative prompt)
- Portkey: 4 of 49 labels negative. "Portkey – Hidden Costs & Design Gaps ... Billing surprise ... Higher latency" (MiniMax M2.5, negative prompt)

## Record

- Method: https://www.gane.ai/index/it/methodology
- License: CC BY 4.0. Cite as Gane Index, September 2026 Edition, www.gane.ai/index/it.