Error and crash monitoring
Asked as “error monitoring tool”, and as “application error and crash reporting service”, on behalf of a mid-market B2B company. 50 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
76%
Clear leader
76Sentry12Rollbar06Bugsnag06others
76% of first choices, clear leader.
Since October 2026=heldSince October 2026: 76% → 76%, ±0 points. Inside the 11-point floor: within noise.Sentry held the lead, ±0 points on 76%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Sentry76%Clear leader▲+7Since October 2026: 69% → 76%, +7 points. Inside the 11-point floor: within noise.Standing →Mid-marketSentry76%Clear leader=heldSince October 2026: 76% → 76%, ±0 points. Inside the 11-point floor: within noise.This pageEnterpriseSentry61%Clear leader▼−14Since October 2026: 75% → 61%, −14 points. Past the 11-point floor: movement.Standing →
Sentry76%Clear leader▲+7Since October 2026: 69% → 76%, +7 points. Inside the 11-point floor: within noise.Standing →Mid-marketSentry76%Clear leader=heldSince October 2026: 76% → 76%, ±0 points. Inside the 11-point floor: within noise.This pageEnterpriseSentry61%Clear leader▼−14Since October 2026: 75% → 61%, −14 points. Past the 11-point floor: movement.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01Sentry76%13%78endorsed leader=heldSince October 2026: 76% → 76%, ±0 points. Inside the 11-point floor: within noise.76% → 76%
Sentry76%13%78endorsed leader=heldSince October 2026: 76% → 76%, ±0 points. Inside the 11-point floor: within noise.76% → 76%02
Rollbar12%11%64accepted challenger▲+4Since October 2026: 8% → 12%, +4 points. Inside the 11-point floor: within noise.8% → 12%
Rollbar12%11%64accepted challenger▲+4Since October 2026: 8% → 12%, +4 points. Inside the 11-point floor: within noise.8% → 12%03
Bugsnag6%5%64accepted challenger▲+2Since October 2026: 4% → 6%, +2 points. Inside the 11-point floor: within noise.4% → 6%
Bugsnag6%5%64accepted challenger▲+2Since October 2026: 4% → 6%, +2 points. Inside the 11-point floor: within noise.4% → 6%04
GlitchTip4%0%20accepted challenger▲+2Since October 2026: 2% → 4%, +2 points. Inside the 11-point floor: within noise.2% → 4%
GlitchTip4%0%20accepted challenger▲+2Since October 2026: 2% → 4%, +2 points. Inside the 11-point floor: within noise.2% → 4%05
Datadog Error Tracking2%36%53criticized challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%
Datadog Error Tracking2%36%53criticized challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%Show the five products at 0%, ordered by negative rate
09
New Relic Errors Inbox0%30%30criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
New Relic Errors Inbox0%30%30criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%08
LogRocket0%17%23accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
LogRocket0%17%23accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%10
Airbrake0%8%13accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Airbrake0%8%13accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%07
Raygun0%5%22accepted challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%
Raygun0%5%22accepted challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%06
Honeybadger0%4%27accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Honeybadger0%4%27accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All ten head-to-head pages: the top five products, each against each
One product takes 76% of first choices here, so the chart would put nine markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Two products carry a negative rate above 25% in this category.
What they warned about
Ten of fourteen models held their first choice under the paraphrase. Mistral Small, DeepSeek V4 Flash, MiniMax M2.5 and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Datadog Error Tracking36%
19 of 53 labels negative · 11 of 14 models · 3 hard negative
“Avoid or be extremely cautious with: - Datadog — if cost predictability matters (bills can grow 10x unexpectedly)” Kimi K2, negative prompt
Sentry13%
10 of 78 labels negative · 10 of 14 models
“Research by Wallarm demonstrated how services like Sentry and Datadog could be manipulated through UI integration to capture sensitive information” MiniMax M2.5, negative prompt
Rollbar11%
7 of 64 labels negative · 7 of 14 models
“Error monitoring gems like Sentry , Rollbar and Honeybadger ... put a company at risk if secrets, tokens, or PII slip into error reports.” Muse Glimmer 30B, negative prompt
New Relic Errors Inbox30%
9 of 30 labels negative · 6 of 14 models · 2 hard negative
“Avoid enterprise tools like Datadog or New Relic initially” Grok 4.20, budget prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
71 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 718 links across 190 sites, every framing counted. Ranked by the number of answers carrying the site or page. 50 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · ONES.com33 answers · 50 citations · 10 models
vendor site · Sentry29 answers · 35 citations · 10 models
vendor site · Rollbar22 answers · 49 citations · 11 models
22 answers · 22 citations · 8 models
vendor site · CubeAPM16 answers · 16 citations · 7 models
vendor site · Sentry13 answers · 21 citations · 6 models
vendor site · LogRocket13 answers · 15 citations · 10 models
vendor site · Guideflow13 answers · 13 citations · 5 models
12 answers · 13 citations · 8 models
12 answers · 13 citations · 7 models
12 answers · 12 citations · 7 models
10 answers · 10 citations · 6 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
26 answers · 10 models
22 answers · 8 models
15 answers · 8 models
14 answers · 7 models
12 answers · 5 models
12 answers · 8 models
11 answers · 10 models
10 answers · 6 models
10 answers · 5 models
9 answers · 7 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best error monitoring tool”, “error monitoring tool”, “error monitoring tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Sentry sentry.io | 76% | 266 | 90,500 | 21,086 | 254,686 | 120 | 1 | |
| Rollbar rollbar.com | 12% | 168 | 5,400 | 175 | 12,382 | 5 | 5 | |
| Bugsnag bugsnag.com | 6% | 154 | 1,600 | 23 | 1,512 | 4 | 6 | |
| GlitchTip glitchtip.com | 4% | 54 | 590 | 9 | 250 | 8 | ||
| Datadog parent site Datadog Error Tracking 2% | 2% | 128 | 74,000 | 3,541 | ||||
| Honeybadger honeybadger.io | 0% | 100 | 201,000 | 98 | 13,851 | |||
| Raygun raygun.com | 0% | 66 | 60,500 | 1,699 | 21,222 | 29 | 5 | |
| LogRocket logrocket.com | 0% | 51 | 3,600 | 83 | 252,222 | 11 | 3 | |
| New Relic newrelic.com New Relic Errors Inbox 0% | 0% | 77 | 14,800 | 843 | 83,276 company | $412 | 89 | |
| Airbrake airbrake.io | 0% | 39 | 5,400 | 164 | 10,122 |
Google's top ten for the three searches hold 13 sites; 3 of them are among the sites the models cited here (logrocket.com, rollbar.com, sentry.io). The first result for “best error monitoring tool” is sentry.io.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best error monitoring tool for a mid-market B2B company?”Paraphrase“Which application error and crash reporting service would you recommend to a mid-sized B2B company?”Comparative“What are the top error monitoring tools and how do they differ?”Budget-constrained“What is the best error monitoring tool for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating an error monitoring tool. What should we look at?”Negative“Which error monitoring tools should I avoid or be cautious about?”
Claude Haiku 4.5SentrySentryHeldSentrySentryagainst: Bugsnag, Elastic APMno first choicenothing named
Two alternatives
Datadog Error Tracking, RollbarThree alternatives
Bugsnag, Datadog Error Tracking, HoneybadgerFive alternatives
Better Stack, Datadog Error Tracking, Honeybadger, LogRocket, RollbarTwo alternatives
LogRocket, RollbarGPT-5.4 miniSentrySentryHeldSentryRollbarno first choiceagainst: Datadog Error Tracking, Rollbar, Sentry
Two alternatives
Bugsnag, Datadog Error TrackingFour alternatives
Bugsnag, Datadog Error Tracking, Firebase Crashlytics, RollbarFour alternatives
Bugsnag, Datadog Error Tracking, New Relic Errors Inbox, RollbarTwo alternatives
Bugsnag, SentryGemini 3.5 FlashSentrySentryHeldSentryagainst: Datadog Error Tracking, Dynatrace, New Relic Errors InboxGlitchTipno first choiceagainst: Amazon CloudWatch, Azure Monitor, Datadog Error Tracking, Dynatrace, Elastic Stack, Errbit, FullStory, Google Cloud Logging, LogRocket, Microsoft Fabric, Rollbar, Sentry, Splunk, Visual Studio App Center
Three alternatives
Bugsnag, Datadog Error Tracking, LogRocketThree alternatives
Bugsnag, Datadog Error Tracking, RaygunFour alternatives
Bugsnag, LogRocket, Raygun, RollbarThree alternatives
Google Cloud Error Reporting, Highlight.io, SentryPerplexity SonarSentrySentryHeldSentryRollbarno first choiceagainst: Bugsnag, Datadog Error Tracking, Rollbar, Sentry
Four alternatives
Bugsnag, Datadog Error Tracking, Honeybadger, RollbarFour alternatives
Bugsnag, Datadog Error Tracking, Firebase Crashlytics, RollbarEleven alternatives
Airbrake, Bugsnag, Datadog Error Tracking, Firebase Crashlytics, GlitchTip, Honeybadger, LogRocket, New Relic Errors Inbox, Raygun, Rollbar, SigNozFour alternatives
Bugsnag, GlitchTip, Honeybadger, SentryGrok 4.20Sentryagainst: Datadog Error Tracking, New Relic Errors InboxSentryHeldagainst: Datadog Error Tracking, Firebase Crashlytics, New Relic Errors InboxSentrySentryagainst: Datadog Error Tracking, New Relic Errors InboxSentryagainst: Datadog Error Trackingagainst: Datadog Error Tracking, New Relic Errors Inbox, Sentry
Three alternatives
Bugsnag, Honeybadger, RollbarFive alternatives
Bugsnag, GlitchTip, Raygun, Rollbar, SigNozFour alternatives
Datadog Error Tracking, Dynatrace, New Relic Errors Inbox, RollbarFour alternatives
Bugsnag, GlitchTip, Highlight.io, RollbarFour alternatives
Bugsnag, New Relic Errors Inbox, Raygun, RollbarMistral SmallSentryBugsnag, SentryChangedSentrySentryno first choiceagainst: Datadog Error Tracking, LogRocket, New Relic Errors Inbox, Rollbar
Three alternatives
Bugsnag, LogRocket, RollbarEight alternatives
Better Stack, Bugsnag, Datadog Error Tracking, GlitchTip, Hyperlook, New Relic Errors Inbox, Raygun, RollbarTwo alternatives
Honeybadger, RollbarDeepSeek V4 FlashRollbaragainst: Datadog Error TrackingSentryChangedSentryagainst: Datadog Error TrackingSentrySentryagainst: Bugsnag, Datadog Error Tracking, Google Cloud Error Reporting, New Relic Errors Inbox, Prometheus + Grafana, Rollbar, Sentry
Three alternatives
Bugsnag, Honeybadger, SentryThree alternatives
Bugsnag, Honeybadger, RollbarFive alternatives
Better Stack, Bugsnag, Honeybadger, New Relic Errors Inbox, RollbarFour alternatives
Bugsnag, GlitchTip, PostHog, RollbarFour alternatives
Bugsnag, Datadog Error Tracking, New Relic Errors Inbox, RollbarLlama 4 MaverickSentrySentryHeldno first choiceBugsnagno first choicenothing named
Three alternatives
Bugsnag, Raygun, RollbarFour alternatives
Airbrake, GlitchTip, Rollbar, TrackJSQwen 3.7 FlashSentrySentryHeldSentryagainst: Datadog Error Tracking, Dynatrace, New Relic Errors InboxSentryRollbar, Sentryagainst: Airbrake, AppDynamics, Dynatrace, Sentry
Three alternatives
Datadog Error Tracking, Honeybadger, RollbarTwo alternatives
Bugsnag, RollbarFour alternatives
Bugsnag, LogRocket, Raygun, RollbarTwo alternatives
Bugsnag, RollbarTwo alternatives
Datadog Error Tracking, New Relic Errors InboxKimi K2SentrySentryHeldSentrySentryDatadog Error Tracking, Sentryagainst: Datadog Error Tracking, FullStory, Hotjar, LogRocket, Sentry
Two alternatives
Bugsnag, RollbarOne alternative
RollbarSix alternatives
Bugsnag, Datadog Error Tracking, LogRocket, New Relic Errors Inbox, Raygun, RollbarThree alternatives
Bugsnag, GlitchTip, RollbarThree alternatives
Bugsnag, Raygun, RollbarGLM 4.7 FlashXSentryagainst: Datadog Error TrackingSentryHeldSentryBugsnagno first choiceagainst: Datadog Error Tracking, Debug Bar, New Relic Errors Inbox, PHPCompatibility, Tracetest
Three alternatives
Bugsnag, Honeybadger, RollbarThree alternatives
Bugsnag, Raygun, RollbarTen alternatives
AppSignal, Bugsnag, Datadog Error Tracking, GlitchTip, LogRocket, New Relic Errors Inbox, PostHog, Raygun, Rollbar, TrackJSThree alternatives
Airbrake, Rollbar, SentryMiniMax M2.5RollbarSentryChangedSentrySentryno first choiceagainst: Datadog Error Tracking, Sentry
Two alternatives
Bugsnag, SentryFour alternatives
Bugsnag, Datadog Error Tracking, Raygun, RollbarFive alternatives
AppDynamics, Datadog Error Tracking, Elastic Observability, New Relic Errors Inbox, RollbarOne alternative
GlitchTipGPT-6 LunaSentrySentryHeldSentryGlitchTipno first choiceagainst: Datadog Error Tracking, Rollbar, Sentry
Three alternatives
Bugsnag, Datadog Error Tracking, RollbarTwo alternatives
Bugsnag, Datadog Error TrackingFive alternatives
Bugsnag, Datadog Error Tracking, Firebase Crashlytics, New Relic Errors Inbox, RollbarOne alternative
SentryMuse Glimmer 30BRollbar, SentrySentryChangedSentryagainst: RaygunSentryno first choiceagainst: Honeybadger, LogRocket, Rollbar, Sentry, TrackJS
Two alternatives
Datadog Error Tracking, New Relic Errors InboxThree alternatives
Bugsnag, Firebase Crashlytics, RollbarSix alternatives
Bugsnag, Datadog Error Tracking, Dynatrace, LogRocket, New Relic Errors Inbox, RollbarSix alternatives
Better Stack, Bugsnag, GlitchTip, PostHog, Rollbar, TempsBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 17:38 | yes | 10 | 8 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 10:22 | yes | 3 | 7 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 16:51 | no | 0 | 18 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 16:01 | yes | 10 | 3 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 19:18 | yes | 5 | 9 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 10:53 | yes | 5 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 16:43 | yes | 23 | 26 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 08:57 | yes | 5 | 3 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:19 | no | 0 | 31 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 10:28 | yes | 15 | 26 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 14:45 | yes | 23 | 43 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 17:23 | yes | 5 | 20 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 17:52 | yes | 4 | 15 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 12:19 | yes | 15 | 24 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 12:47 | yes | 10 | 7 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 15:52 | no | 0 | 2 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 18:36 | no | 0 | 18 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 18:08 | yes | 10 | 3 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 18:45 | yes | 5 | 9 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 16:26 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 09:28 | yes | 24 | 24 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 16:23 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:10 | yes | 5 | 29 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 19:17 | yes | 24 | 28 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 15:48 | yes | 19 | 29 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 16:13 | yes | 5 | 53 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 08:40 | yes | 3 | 7 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 17:52 | yes | 13 | 18 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 10:59 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 08:47 | yes | 5 | 8 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 14:37 | no | 0 | 16 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 15:26 | yes | 10 | 6 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:41 | yes | 5 | 13 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 10:58 | yes | 5 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 17:59 | yes | 21 | 39 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 10:58 | yes | 5 | 3 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 14:01 | yes | 5 | 18 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 10:24 | yes | 15 | 47 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 14:55 | yes | 5 | 37 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 15:00 | no | 0 | 13 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 12:38 | yes | 6 | 13 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 16:32 | yes | 15 | 30 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 13:23 | no | 0 | 5 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 10:04 | yes | 3 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 18:28 | yes | 7 | 21 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 12:22 | yes | 10 | 7 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:04 | yes | 10 | 13 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 18:12 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 19:05 | yes | 14 | 30 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 17:25 | yes | 5 | 3 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:35 | yes | 5 | 13 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 16:57 | yes | 5 | 33 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 10:46 | yes | 5 | 12 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 16:01 | yes | 10 | 28 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 10:50 | yes | 2 | 14 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 09:04 | yes | 15 | 25 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 14:33 | no | 0 | 7 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 13:17 | no | 0 | 9 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 14:40 | no | 0 | 18 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 11:50 | yes | 10 | 7 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 16:34 | yes | 5 | 14 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 17:54 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 17:54 | yes | 19 | 33 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 12:28 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 14:14 | no | 0 | 30 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 18:52 | yes | 14 | 24 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 15:27 | yes | 10 | 19 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 15:22 | yes | 5 | 33 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 09:46 | yes | 2 | 12 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 13:03 | yes | 14 | 25 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 15:02 | no | 0 | 4 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 12:44 | yes | 5 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 08:45 | yes | 5 | 18 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 08:37 | yes | 10 | 4 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:04 | yes | 15 | 16 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 11:58 | yes | 5 | 4 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 18:16 | yes | 25 | 40 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 16:28 | yes | 10 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 17:39 | yes | 14 | 45 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 11:59 | yes | 25 | 24 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 12:50 | yes | 24 | 141 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:33 | yes | 15 | 51 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 17:07 | yes | 3 | 15 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 14:01 | yes | 25 | 35 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
DataDog read as Datadog Error Tracking
Datadog read as Datadog Error Tracking
Datadog (Errors) read as Datadog Error Tracking
Elastic (ELK Stack + Observability) read as Elastic Observability
New Relic read as New Relic Errors Inbox
Scout read as Scout Monitoring
Unresolved, counted raw
Debug Bar (WordPress)
PHPCompatibility
Tracetest
Visual Studio App Center (Microsoft)
Discontinued, still offered
No shut-down product was recommended here.