Application performance monitoring
Asked as “APM tool”, and as “application performance monitoring solution”, on behalf of a mid-market B2B company. 46 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
54%
Clear leader
54New Relic13SigNoz11Datadog APM22others
54% of first choices, clear leader.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the four products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All twenty-one head-to-head pages: the top seven products, each against each
New Relic vs IBM InstanaNew Relic vs ManageEngine Applications ManagerNew Relic vs HoneycombSigNoz vs Datadog APMSigNoz vs Grafana CloudSigNoz vs IBM InstanaSigNoz vs ManageEngine Applications ManagerSigNoz vs HoneycombDatadog APM vs Grafana CloudDatadog APM vs IBM InstanaDatadog APM vs ManageEngine Applications ManagerDatadog APM vs HoneycombGrafana Cloud vs IBM InstanaGrafana Cloud vs ManageEngine Applications ManagerGrafana Cloud vs HoneycombIBM Instana vs ManageEngine Applications ManagerIBM Instana vs HoneycombManageEngine Applications Manager vs Honeycomb
One product takes 54% of first choices here, so the chart would put ten markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Three products carry a negative rate above 25% in this category.
What they warned about
Seven of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Mistral Small, Llama 4 Maverick, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Datadog APM37%
23 of 63 labels negative · 11 of 12 models · 2 hard negative
“High Caution: Major Commercial APM Vendors ... Unpredictable pricing - Bills can triple or quadruple at scale” Kimi K2, negative prompt
Dynatrace42%
19 of 45 labels negative · 10 of 12 models · 2 hard negative
“Most expensive at scale among commercial APMs ... Memory-based pricing makes bills unpredictable” Kimi K2, negative prompt
New Relic15%
10 of 67 labels negative · 8 of 12 models · 1 hard negative
“Pricing model confusion ... Stability concerns - users report "laughable" stability in some regions” Kimi K2, negative prompt
AppDynamics27%
7 of 26 labels negative · 7 of 12 models · 2 hard negative
“Scalability issues - doesn't scale well; requires multiple controllers that don't communicate” Kimi K2, negative prompt
What they cite
Twelve of the twelve models returned a source list in this edition: four return the pages they cited and eight the search results they consulted.
Sites the answers cite
63 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 839 links across 187 sites, every framing counted. Ranked by the number of answers carrying the site or page.
vendor site · ManageEngine29 answers · 33 citations · 11 models
29 answers · 29 citations · 11 models
vendor site · New Relic28 answers · 43 citations · 9 models
vendor site · CubeAPM26 answers · 29 citations · 11 models
vendor site · G224 answers · 49 citations · 9 models
vendor site · OpenObserve23 answers · 27 citations · 8 models
vendor site · Rollbar23 answers · 23 citations · 10 models
vendor site · Instatus20 answers · 20 citations · 8 models
vendor site · Motadata17 answers · 17 citations · 9 models
vendor site · G216 answers · 17 citations · 9 models
16 answers · 16 citations · 8 models
15 answers · 15 citations · 6 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
29 answers · 11 models
23 answers · 10 models
20 answers · 8 models
19 answers · 8 models
18 answers · 10 models
18 answers · 8 models
17 answers · 9 models
16 answers · 8 models
15 answers · 6 models
15 answers · 9 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “apm tool”, “apm tools”, “best apm tool”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| New Relic newrelic.com | 54% | 595 | 14,800 | 843 | 83,276 | $412 | 89 | 4 |
| SigNoz signoz.io | 13% | 179 | 2,400 | 52 | 7,244 | 1 | 5 | |
| Datadog datadoghq.com Datadog APM 11% | 11% | 185 | 74,000 | 3,541 | 159,408 company | $633 | 120 | |
| Grafana Cloud grafana.com Grafana Cloud 4%, Prometheus + Grafana 0% | 4% | 183 | 2,400 | 40 | 84,520 | 116 | ||
| ManageEngine parent site ManageEngine Applications Manager 2%, ManageEngine OpManager Nexus 2% | 4% | 33 | 8,100 | 675 | ||||
| IBM parent site IBM Instana 2% | 2% | 108 | 201,000 | 34,098 | ||||
| Honeycomb honeycomb.io | 2% | 105 | 135,000 | 13,732 | 6,603 | 65 | ||
| OpenObserve openobserve.ai | 2% | 85 | 1,600 | 9 | 4,825 | 7 | 5 | |
| Site24x7 site24x7.com | 2% | 304 | 1,300 | 61 | 174,542 | $522 | 120 | |
| Scout scoutapm.com Scout APM 2% | 2% | 28 | 170 | 0 | 4,420 company | 1 |
Google's top ten for the three searches hold 15 sites; 4 of them are among the sites the models cited here (manageengine.com, motadata.com, newrelic.com, openobserve.ai). The first result for “apm tool” is blazemeter.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best APM tool for a mid-market B2B company?”Paraphrase“Which application performance monitoring solution would you recommend to a mid-sized B2B company?”Comparative“What are the top APM tools and how do they differ?”Budget-constrained“What is the best APM tool for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a APM tool. What should we look at?”Negative“Which APM tools should I avoid or be cautious about?”
Claude Haiku 4.5no first choiceagainst: DynatraceIBM Instana, SigNozChangedManageEngine OpManager NexusNew Relicno first choiceagainst: Datadog APM
One alternative
Elastic APMThree alternatives
Atatus, Elastic APM, Scout APMGPT-5.4 miniNew RelicNew RelicHeldno first choiceGrafana Cloudagainst: Datadog APMno first choicenothing named
Four alternatives
AppDynamics, Datadog APM, Dynatrace, Grafana CloudThree alternatives
AppDynamics, Datadog APM, DynatraceFive alternatives
AppDynamics, Datadog APM, Dynatrace, Elastic APM, New RelicThree alternatives
Elastic Observability, New Relic, OpenTelemetryGemini 3.5 FlashNew Relicagainst: Datadog APMNew RelicHeldagainst: Datadog APM, DynatraceDatadog APMGrafana Cloud, New Relicagainst: Datadog APM, DynatraceHoneycombagainst: Datadog APM, Dynatrace, New Relicagainst: AppDynamics, Datadog APM, Dynatrace, Grafana Cloud, Jaeger, New Relic, Prometheus, SigNoz, Splunk Observability Cloud
Two alternatives
Honeycomb, SentryFour alternatives
Grafana Cloud, Honeycomb, Sentry, SigNozFive alternatives
AppDynamics, Dynatrace, Grafana Cloud / LGTM Stack, Honeycomb, New RelicFour alternatives
AppSignal, OpenObserve, Sentry, SigNozFour alternatives
Grafana Cloud, Highlight.io, Sentry, SigNozPerplexity SonarNew RelicNew RelicHeldDatadog APMNew Relic, Scout APMagainst: Prometheus + Grafanano first choiceagainst: AppDynamics, Datadog APM, Dynatrace, Honeycomb, New Relic, Splunk Observability Cloud
Four alternatives
Datadog APM, Dynatrace, ManageEngine Applications Manager, OpManager NexusFive alternatives
Datadog APM, IBM Instana, ManageEngine Applications Manager, Site24x7, SolarWinds ObservabilitySix alternatives
AppDynamics, Dynatrace, Elastic APM, New Relic, SigNoz, Splunk Observability CloudTwo alternatives
CubeAPM, SigNozGrok 4.20New RelicNew RelicHeldDatadog APMNew Relicagainst: Datadog APM, Jaeger, Prometheus + Grafanano first choiceagainst: AppDynamics, Broadcom DX APM, Datadog APM, Dynatrace, New Relic
Three alternatives
Datadog APM, ManageEngine Applications Manager, SolarWinds ObservabilityFour alternatives
Datadog APM, Dynatrace, SigNoz, Site24x7Two alternatives
Dynatrace, New RelicOne alternative
SigNozMistral SmallNew RelicDatadog APM, New RelicChangedDatadog APMNew Relic, SigNozagainst: CubeAPMno first choiceagainst: AppDynamics
One alternative
Datadog APMTwo alternatives
IBM Instana, ManageEngine Applications ManagerThree alternatives
Dynatrace, Elastic APM, New RelicOne alternative
Prometheus + GrafanaDeepSeek V4 FlashNew Relicagainst: Datadog APM, DynatraceNew RelicHeldagainst: DynatraceDatadog APM, DynatraceNew Relic, SigNozagainst: Datadog APMNew Relicagainst: Datadog APMagainst: AppDynamics, Azure Monitor Application Insights, Broadcom DX APM, Datadog APM, Dynatrace, IBM Instana
One alternative
ManageEngine Applications ManagerTwo alternatives
Datadog APM, Grafana CloudFive alternatives
AppDynamics, Elastic APM, Honeycomb, New Relic, Open-sourceFour alternatives
Atatus, Grafana Cloud, Prometheus, SentryOne alternative
SigNozLlama 4 Maverickno first choiceSite24x7Changedno first choiceManageEngine OpManager Nexusno first choiceagainst: Datadog APM, Dynatrace, New Relic, Splunk
Five alternatives
Datadog APM, Dynatrace, IBM Instana, ManageEngine Applications Manager, New RelicTwo alternatives
Atatus, CubeAPMQwen 3.7 FlashDatadog APMDatadog APMHeldDatadog APMNew Relic, SigNozagainst: Datadog APM, DynatraceDatadog APMagainst: AppDynamicsagainst: Apache SkyWalking, Datadog APM, Dynatrace, Jaeger, New Relic, OpenTelemetry
Three alternatives
IBM Instana, New Relic, SentryThree alternatives
Grafana Cloud, Honeycomb, New RelicSix alternatives
AppDynamics, Dynatrace, Elastic APM, IBM Instana, New Relic, SentryFive alternatives
Elastic APM, Grafana Stack, ManageEngine OpManager Nexus, OpenObserve, Site24x7Two alternatives
Dynatrace, New RelicKimi K2New Relicagainst: Datadog APMNew RelicHeldagainst: Datadog APM, DynatraceDatadog APMSigNozNew Relicagainst: AppDynamics, Datadog APM, Dynatrace, New Relic
Two alternatives
ManageEngine Applications Manager, SolarWinds ObservabilityFour alternatives
Atatus, ManageEngine Applications Manager, Sentry, SigNozFour alternatives
AppDynamics, Dynatrace, Grafana Cloud, New RelicThree alternatives
New Relic, Prometheus + Grafana + Loki + Tempo, SentryThree alternatives
Datadog APM, Dynatrace, Site24x7GLM 4.7 FlashXNew Relicagainst: Dynatraceno first choiceChangedDatadog APMOpenObserve, SigNozno first choiceagainst: Datadog APM, Dynatrace, LogicMonitor LM APM Synthetics, ManageEngine Applications Manager, New Relic, SAP Legacy APM Products, Site24x7, SolarWinds AppOptics
Seven alternatives
AppDynamics, Datadog APM, Grafana/Tempo, OpenObserve, OpenTelemetry, SigNoz, SolarWinds Applications ManagerNine alternatives
AppDynamics, Azure Monitor Application Insights, Dynatrace, Elastic APM, Grafana Cloud, IBM Instana, New Relic, Sentry, SolarWinds ObservabilityThree alternatives
Grafana Cloud, New Relic, Prometheus + GrafanaMiniMax M2.5ManageEngine Applications Manager, SolarWinds APMDatadog APMChangedDatadog APM, DynatraceNew Relicno first choiceagainst: Datadog APM, Dynatrace, New Relicagainst: Datadog APM, Dynatrace, New Relic
One alternative
Pandora FMSTwo alternatives
IBM Instana, New RelicFour alternatives
IBM Instana, LogRocket, New Relic, SentryThree alternatives
Elastic APM, Grafana Cloud, SentryBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:56 | no | 0 | 5 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:51 | yes | 6 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:12 | yes | 13 | 27 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-17 10:25 | yes | 20 | 5 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:28 | yes | 38 | 19 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:22 | yes | 5 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:40 | yes | 20 | 17 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:54 | yes | 5 | 3 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 09:24 | no | 0 | 42 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 12:17 | yes | 9 | 29 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:10 | yes | 14 | 158 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 09:32 | yes | 5 | 14 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:37 | yes | 18 | 10 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:25 | yes | 3 | 6 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:43 | yes | 10 | 22 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-17 09:31 | yes | 20 | 5 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:21 | yes | 19 | 9 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 09:51 | yes | 5 | 6 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 13:16 | yes | 20 | 17 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 14:11 | yes | 5 | 4 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 09:54 | no | 0 | 40 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:56 | yes | 19 | 58 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 11:56 | yes | 10 | 12 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:35 | yes | 10 | 23 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:39 | yes | 9 | 8 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:23 | yes | 5 | 7 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:09 | yes | 19 | 25 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-17 11:02 | yes | 20 | 10 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 13:19 | yes | 25 | 13 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:12 | yes | 5 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 10:13 | yes | 10 | 17 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:52 | yes | 5 | 3 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:55 | yes | 10 | 60 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 14:02 | yes | 9 | 27 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:23 | yes | 25 | 43 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 13:26 | yes | 15 | 49 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 12:48 | yes | 9 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 09:24 | no | 0 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:09 | yes | 12 | 22 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-17 12:02 | yes | 20 | 5 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 09:58 | yes | 13 | 6 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:07 | yes | 5 | 6 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 10:08 | yes | 10 | 12 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:53 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 11:21 | yes | 5 | 24 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:03 | yes | 13 | 27 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:38 | yes | 10 | 33 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:01 | yes | 5 | 25 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:42 | no | 0 | 7 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:50 | no | 0 | 6 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:37 | no | 0 | 15 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-17 09:30 | yes | 17 | 8 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:35 | yes | 13 | 11 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:24 | no | 0 | 6 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 09:54 | yes | 14 | 25 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:26 | yes | 5 | 4 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 13:08 | no | 0 | 41 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 10:59 | yes | 14 | 25 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:35 | yes | 14 | 136 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:53 | yes | 5 | 28 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 09:43 | yes | 19 | 8 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:52 | yes | 3 | 8 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:27 | yes | 12 | 24 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-17 11:54 | yes | 20 | 7 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 13:50 | yes | 34 | 18 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:38 | yes | 5 | 6 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 13:54 | yes | 27 | 45 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:10 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 11:00 | yes | 25 | 52 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 10:53 | yes | 25 | 34 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:15 | yes | 30 | 75 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 13:37 | yes | 14 | 40 s |
Noise floor in this category
Flips between the edition run and its calibration repeat. Six prompts per model is a small sample; the index-wide floor is the number to trust.
ShowHide
Claude Haiku 4.5
4 of 4 flipped
GPT-5.4 mini
1 of 3 flipped
Gemini 3.5 Flash
3 of 5 flipped
Perplexity Sonar
3 of 4 flipped
Grok 4.20
3 of 5 flipped
Mistral Small
3 of 4 flipped
DeepSeek V4 Flash
3 of 6 flipped
Llama 4 Maverick
3 of 3 flipped
Qwen 3.7 Flash
4 of 5 flipped
Kimi K2
3 of 5 flipped
GLM 4.7 FlashX
3 of 4 flipped
MiniMax M2.5
3 of 4 flipped
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Datadog read as Datadog APM
Elastic read as Elastic APM
Grafana read as Grafana Cloud
Scout Monitoring read as Scout APM
SolarWinds read as SolarWinds Observability
SolarWinds (AppOptics or Observability) read as SolarWinds Observability
Splunk APM read as Splunk Observability Cloud
Unresolved, counted raw
LogicMonitor LM APM Synthetics
Open-source (Prometheus/Grafana/OpenTelemetry/Jaeger)
SAP Legacy APM Products
SolarWinds APM
SolarWinds Applications Manager
Splunk On-Demand
Discontinued, still offered
No shut-down product was recommended here.