Zero of fourteen models named Helicone first on the direct prompt; one named OpenRouter. Helicone was named by seven of the fourteen models and OpenRouter by fourteen and Helicone carries 16 labels and OpenRouter 41, so the shares are not directly comparable.
Named in one category this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the LLM gateways and observability page.
Across every category in the November 2026 Edition, Helicone and OpenRouter were named in the same answer twenty-six times, of the 58 answers naming Helicone and the 120 naming OpenRouter. In those answers OpenRouter took the first choice three times and Helicone two.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of five in this category shown.
“Managed/third-party hosted gateways with weak privacy controls (e.g., some observability-focused ones like early PromptLayer or Helicone variants)” Grok 4.20 · negative prompt · soft negative
“My top pick for a typical mid-sized B2B company: Start with Helicone.” Qwen 3.7 Flash · paraphrase prompt · first choice
“I recommend Helicone as the best all-around choice” Kimi K2 · paraphrase prompt · first choice
“Excellent observability, caching, and cost analytics | Stronger on monitoring than routing; paid plans for advanced usage” Grok 4.20 · budget prompt · alternative
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“The one I would not recommend for a mid-market B2B company is OpenRouter” DeepSeek V4 Flash · direct prompt · hard negative
“"avoid OpenRouter for anything with sensitive/PII data" [4]” Muse Glimmer 30B · negative prompt · hard negative
“Exercise caution with OpenRouter, Portkey, Vercel AI Gateway, and similar services when prompts contain personal, regulated, proprietary, or agent data.” Perplexity Sonar · negative prompt · soft negative
“Best default for most mid-market teams: OpenRouter” GPT-5.4 mini · direct prompt · first choice
“Well‑documented, transparent marketplaces that expose provider lists, pricing, and model performance data (e.g., OpenRouter, Portkey AI Gateway)” GLM 4.7 FlashX · negative prompt · alternative
“Choose Cloudflare or OpenRouter if you want zero infrastructure maintenance and fast deployment out of the box.” Gemini 3.5 Flash · comparative prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.