Error and crash monitoring
Asked as “error monitoring tool”, and as “application error and crash reporting service”, on behalf of a mid-market B2B company. 44 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
82%
Clear leader
82Sentry14Rollbar02GlitchTip02others
82% of first choices, clear leader.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the seven products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
One product takes 82% of first choices here, so the chart would put nine markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Three products carry a negative rate above 25% in this category.
What they warned about
Eight of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Mistral Small, Qwen 3.7 Flash and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Datadog Error Tracking59%
27 of 46 labels negative · 12 of 12 models · 1 hard negative
“Avoid Datadog if you are a small team without dedicated DevOps” Mistral Small, negative prompt
New Relic Errors Inbox52%
14 of 27 labels negative · 10 of 12 models
“they come with a warning label regarding cost control... you might accidentally flood these tools with data and wake up to a bill for $5,000+” Qwen 3.7 Flash, negative prompt
Sentry14%
9 of 65 labels negative · 9 of 12 models · 1 hard negative
“Avoid Sentry if you require deep Application Performance Monitoring (APM)” Mistral Small, negative prompt
Rollbar13%
8 of 63 labels negative · 7 of 12 models · 1 hard negative
“avoid SaaS-only tools like Rollbar” Gemini 3.5 Flash, negative prompt
What they cite
Twelve of the twelve models returned a source list in this edition: four return the pages they cited and eight the search results they consulted.
Sites the answers cite
57 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 781 links across 201 sites, every framing counted. Ranked by the number of answers carrying the site or page.
vendor site · Scout APM40 answers · 43 citations · 10 models
vendor site · Rollbar39 answers · 50 citations · 11 models
vendor site · Guideflow27 answers · 27 citations · 9 models
vendor site · Raygun21 answers · 22 citations · 9 models
19 answers · 21 citations · 7 models
16 answers · 17 citations · 9 models
16 answers · 16 citations · 6 models
16 answers · 16 citations · 9 models
14 answers · 15 citations · 8 models
vendor site · Sauce Labs14 answers · 15 citations · 11 models
vendor site · ONES.com14 answers · 14 citations · 9 models
13 answers · 14 citations · 8 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
39 answers · 9 models
33 answers · 11 models
26 answers · 9 models
20 answers · 9 models
18 answers · 7 models
16 answers · 6 models
16 answers · 9 models
14 answers · 8 models
14 answers · 11 models
13 answers · 8 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best error monitoring tool”, “error monitoring tool”, “error monitoring tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|
| Sentry sentry.io | 82% | 266 | 90,500 | 21,086 | 254,686 | 120 | 1 |
| Rollbar rollbar.com | 14% | 168 | 5,400 | 175 | 12,382 | 5 | 5 |
| GlitchTip glitchtip.com | 2% | 54 | 590 | 9 | 250 | 8 | |
| Scout scoutapm.com Scout Monitoring 2% | 2% | 3 | 50 | 4 | 4,420 company | 1 | 2 |
| Bugsnag bugsnag.com | 0% | 154 | 1,600 | 23 | 1,512 | 4 | 6 |
| Honeybadger honeybadger.io | 0% | 100 | 201,000 | 98 | 13,851 | ||
| Raygun raygun.com | 0% | 66 | 60,500 | 1,699 | 21,222 | 29 | 5 |
| LogRocket logrocket.com | 0% | 51 | 3,600 | 83 | 252,222 | 11 | 3 |
| Better Stack betterstack.com | 0% | 311 | 1,600 | 1,017 | 41,811 | 119 | |
| Bugsink bugsink.com | 0% | 5 | 140 | 1 | 403 |
Google's top ten for the three searches hold 13 sites; 5 of them are among the sites the models cited here (observeone.com, raygun.com, rollbar.com, saucelabs.com, scoutapm.com). The first result for “best error monitoring tool” is sentry.io.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best error monitoring tool for a mid-market B2B company?”Paraphrase“Which application error and crash reporting service would you recommend to a mid-sized B2B company?”Comparative“What are the top error monitoring tools and how do they differ?”Budget-constrained“What is the best error monitoring tool for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating an error monitoring tool. What should we look at?”Negative“Which error monitoring tools should I avoid or be cautious about?”
Claude Haiku 4.5SentryRollbar, SentryChangedagainst: Datadog Error Trackingno first choiceSentryagainst: Datadog Error Trackingno first choicenothing named
Two alternatives
CubeAPM, RollbarThree alternatives
Bugsnag, New Relic Errors Inbox, RollbarGPT-5.4 miniSentrySentryHeldSentrySentryagainst: Bugsnag, Datadog Error Tracking, New Relic Errors Inboxno first choicenothing named
Three alternatives
Bugsnag, Datadog Error Tracking, RollbarOne alternative
BugsnagThree alternatives
Bugsnag, Datadog Error Tracking, RollbarTwo alternatives
Honeybadger, RollbarGemini 3.5 FlashSentrySentryHeldagainst: Datadog Error Tracking, New Relic Errors InboxSentryGlitchTipagainst: Datadog Error Tracking, New Relic Errors InboxSentryagainst: Airbrake, Bugsnag, FullStory, LogRocket, Rollbar, Sentry
Three alternatives
Bugsnag, Datadog Error Tracking, RollbarTwo alternatives
Bugsnag, RollbarSeven alternatives
Airbrake, Bugsnag, Datadog Error Tracking, Highlight.io, Honeybadger, New Relic Errors Inbox, RollbarFive alternatives
Better Stack, Bugsink, Honeybadger, Rollbar, SentryFive alternatives
Bugsnag, Datadog Error Tracking, Highlight.io, LogRocket, RollbarPerplexity SonarSentrySentryHeldagainst: Datadog Error TrackingSentrySentryno first choiceagainst: Bugsnag, Datadog Error Tracking, New Relic Errors Inbox, Rollbar, Sentry
Three alternatives
Better Stack, Rollbar, Scout MonitoringOne alternative
Firebase CrashlyticsSix alternatives
Airbrake, Bugsnag, Datadog Error Tracking, Honeybadger, New Relic Errors Inbox, RollbarThree alternatives
Better Stack, GlitchTip, HoneybadgerGrok 4.20Sentryagainst: Datadog Error Tracking, New Relic Errors InboxSentryHeldSentryagainst: Datadog Error Tracking, New Relic Errors InboxSentrySentryagainst: Datadog Error Trackingagainst: Bugsnag, Datadog Error Tracking, New Relic Errors Inbox, Rollbar, Scout APM, Sentry
One alternative
RollbarThree alternatives
Bugsnag, Raygun, RollbarTwo alternatives
Bugsnag, RollbarFour alternatives
GlitchTip, Honeybadger, PostHog, RollbarThree alternatives
Bugsnag, LogRocket, RollbarMistral SmallRollbar, Scout Monitoringagainst: Airbrake, HoneybadgerSentryChangedSentryagainst: Datadog Error Tracking, New Relic Errors InboxSentryno first choiceagainst: Bugsnag, Datadog Error Tracking, Rollbar, Scout APM, Sentry
One alternative
SentryOne alternative
Firebase CrashlyticsFour alternatives
Airbrake, Bugsnag, Raygun, RollbarTwo alternatives
Honeybadger, RollbarDeepSeek V4 FlashSentrySentryHeldSentryagainst: Datadog Error TrackingSentryagainst: Grafana CloudSentryagainst: Datadog Error Tracking, Rollbaragainst: AppSignal, Bugsnag, Datadog Error Tracking, Errorception, Highlight.io, Honeybadger, New Relic Errors Inbox, Rollbar, Scout Monitoring, Sentry
Two alternatives
Datadog Error Tracking, RollbarFour alternatives
Bugsnag, Datadog Error Tracking, LogRocket, RollbarFive alternatives
Bugsnag, GlitchTip, Honeybadger, Raygun, RollbarThree alternatives
Bugsink, GlitchTip, HoneybadgerOne alternative
BugsnagLlama 4 Maverickno first choiceno first choiceHeldno first choiceRollbarno first choiceagainst: AppSignal, Datadog Error Tracking, New Relic Errors Inbox, Scout Monitoring, Sentry
Two alternatives
Honeybadger, SentryQwen 3.7 FlashSentryagainst: Datadog Error TrackingRollbar, SentryChangedagainst: Datadog Error TrackingSentrySentryagainst: Honeybadger, RaygunSentryagainst: Datadog Error Tracking, New Relic Errors Inboxagainst: AWS X-Ray, AppDynamics, Azure Monitor, Datadog Error Tracking, Elastic Stack, Habits.io, Logstash, New Relic Errors Inbox, SolarWinds Papertrail, Splunk
Two alternatives
Raygun, RollbarFour alternatives
Airbrake, Bugsnag, Raygun, RollbarThree alternatives
GlitchTip, LogRocket, RollbarTwo alternatives
Honeybadger, RollbarKimi K2Sentryagainst: Datadog Error Tracking, FullStorySentryHeldSentryagainst: Airbrake, Datadog Error TrackingSentryRollbar, Sentryagainst: Datadog Error Trackingagainst: Bugsnag, Datadog Error Tracking, Highlight.io, New Relic Errors Inbox, Rollbar, Sentry
Three alternatives
Bugsnag, LogRocket, RollbarFour alternatives
Datadog APM, LogRocket, Raygun, RollbarThree alternatives
Bugsnag, Honeybadger, RollbarThree alternatives
Bugsnag, GlitchTip, RollbarGLM 4.7 FlashXSentrySentryHeldSentrySentryno first choiceagainst: Datadog Error Tracking, Dynatrace, New Relic Errors Inbox, Rollbar, Sentry
Three alternatives
Better Stack, Bugsnag, RollbarTwo alternatives
Bugsnag, RollbarSix alternatives
Bugsnag, Datadog Error Tracking, LogRocket, Raygun, Rollbar, TrackJSFive alternatives
Bugsnag, GlitchTip, Honeybadger, PostHog, RollbarMiniMax M2.5Rollbar, Sentryagainst: Datadog APMSentryChangedSentryagainst: Datadog Error TrackingSentryno first choiceagainst: Sentry
One alternative
Scout MonitoringTwo alternatives
Datadog Error Tracking, RollbarFive alternatives
Airbrake, Bugsnag, LogRocket, New Relic Errors Inbox, RollbarThree alternatives
GlitchTip, Honeybadger, RollbarBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:20 | yes | 9 | 7 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 09:53 | yes | 5 | 6 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:26 | yes | 11 | 21 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-17 14:03 | yes | 20 | 5 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:27 | yes | 18 | 10 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:17 | yes | 11 | 9 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:47 | yes | 8 | 17 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:38 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 11:58 | no | 0 | 39 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 14:12 | yes | 10 | 54 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:35 | yes | 22 | 138 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:19 | yes | 9 | 54 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 12:39 | no | 0 | 5 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:01 | yes | 1 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:24 | yes | 9 | 20 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-17 12:49 | yes | 18 | 6 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:38 | yes | 44 | 17 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:13 | yes | 5 | 5 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 09:32 | yes | 10 | 13 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:49 | yes | 5 | 3 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 14:09 | yes | 5 | 31 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 12:19 | no | 0 | 44 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 14:14 | yes | 35 | 79 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:11 | yes | 13 | 38 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:35 | yes | 9 | 7 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:11 | yes | 8 | 12 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 13:50 | yes | 12 | 23 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-17 10:53 | yes | 20 | 8 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:58 | yes | 15 | 8 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:12 | yes | 5 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:20 | yes | 14 | 17 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:56 | yes | 5 | 3 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:24 | yes | 5 | 24 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 09:48 | yes | 10 | 31 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:17 | yes | 18 | 42 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 09:58 | yes | 25 | 81 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 09:55 | no | 0 | 4 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:25 | no | 0 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:50 | yes | 13 | 22 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-17 11:03 | yes | 20 | 4 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:38 | yes | 18 | 9 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:09 | yes | 5 | 3 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:59 | yes | 8 | 8 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:31 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:36 | no | 0 | 44 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 10:31 | yes | 15 | 33 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 09:26 | yes | 14 | 82 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:46 | yes | 9 | 18 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 09:30 | no | 0 | 5 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:45 | no | 0 | 6 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:38 | no | 0 | 15 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-17 10:55 | yes | 20 | 7 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 11:06 | yes | 16 | 12 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:11 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 10:28 | yes | 9 | 21 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:23 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:42 | no | 0 | 41 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 10:40 | yes | 9 | 23 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:58 | yes | 19 | 123 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:08 | no | 0 | 55 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:02 | no | 0 | 4 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:25 | no | 0 | 4 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:57 | yes | 19 | 24 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-17 10:18 | yes | 20 | 9 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:24 | yes | 40 | 15 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:36 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 10:24 | yes | 29 | 35 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:50 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:05 | no | 0 | 49 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 13:01 | yes | 24 | 55 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:48 | yes | 21 | 90 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 14:10 | yes | 14 | 29 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Datadog read as Datadog Error Tracking
ELK Stack read as Elastic Stack
New Relic read as New Relic Errors Inbox
Scout read as Scout Monitoring
Unresolved, counted raw
GlitchReplay
Habits.io
Inspectlet
Logwise
Discontinued, still offered
No shut-down product was recommended here.