Incident management and on-call
Asked as “incident management platform”, and as “on-call scheduling and alerting tool”, on behalf of a mid-market B2B company. 57 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
47%
Clear leader
47incident.io25PagerDuty09Rootly19others
47% of first choices, clear leader.
Since October 2026▲+15Since October 2026: 32% → 47%, +15 points. Past the 11-point floor: movement.incident.io held the lead, +15 points on 32%, past the floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
incident.io39%Contested▲+4Since October 2026: 35% → 39%, +4 points. Inside the 11-point floor: within noise.Standing →Mid-marketincident.io47%Clear leader▲+15Since October 2026: 32% → 47%, +15 points. Past the 11-point floor: movement.This pageEnterprise
PagerDuty53%Clear leader▼−4Since October 2026: 57% → 53%, −4 points. Inside the 11-point floor: within noise.Standing →
incident.io39%Contested▲+4Since October 2026: 35% → 39%, +4 points. Inside the 11-point floor: within noise.Standing →Mid-marketincident.io47%Clear leader▲+15Since October 2026: 32% → 47%, +15 points. Past the 11-point floor: movement.This pageEnterprisePagerDuty53%Clear leader▼−4Since October 2026: 57% → 53%, −4 points. Inside the 11-point floor: within noise.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01incident.io47%3%66endorsed leader▲+15Since October 2026: 32% → 47%, +15 points. Past the 11-point floor: movement.32% → 47%
incident.io47%3%66endorsed leader▲+15Since October 2026: 32% → 47%, +15 points. Past the 11-point floor: movement.32% → 47%02PagerDuty25%21%70accepted challenger▲+10Since October 2026: 15% → 25%, +10 points. Inside the 11-point floor: within noise.15% → 25%
PagerDuty25%21%70accepted challenger▲+10Since October 2026: 15% → 25%, +10 points. Inside the 11-point floor: within noise.15% → 25%03
Rootly9%2%42accepted challenger▲+4Since October 2026: 5% → 9%, +4 points. Inside the 11-point floor: within noise.5% → 9%
Rootly9%2%42accepted challenger▲+4Since October 2026: 5% → 9%, +4 points. Inside the 11-point floor: within noise.5% → 9%04
FireHydrant4%9%34accepted challenger▲+2Since October 2026: 2% → 4%, +2 points. Inside the 11-point floor: within noise.2% → 4%
FireHydrant4%9%34accepted challenger▲+2Since October 2026: 2% → 4%, +2 points. Inside the 11-point floor: within noise.2% → 4%05
Squadcast4%0%20accepted challenger▼−4Since October 2026: 8% → 4%, −4 points. Inside the 11-point floor: within noise.8% → 4%
Squadcast4%0%20accepted challenger▼−4Since October 2026: 8% → 4%, −4 points. Inside the 11-point floor: within noise.8% → 4%06
Better Stack4%5%20accepted challenger▼−1Since October 2026: 5% → 4%, −1 point. Inside the 11-point floor: within noise.5% → 4%
Better Stack4%5%20accepted challenger▼−1Since October 2026: 5% → 4%, −1 point. Inside the 11-point floor: within noise.5% → 4%Show the seven products at 0%, ordered by negative rate
13
Opsgenie0%72%43criticized challenger▼−7Since October 2026: 7% → 0%, −7 points. Inside the 11-point floor: within noise.7% → 0%
Opsgenie0%72%43criticized challenger▼−7Since October 2026: 7% → 0%, −7 points. Inside the 11-point floor: within noise.7% → 0%12
ServiceNow ITSM0%50%24criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
ServiceNow ITSM0%50%24criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%11
Splunk On-Call0%37%19criticized challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%
Splunk On-Call0%37%19criticized challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%09
Freshservice0%21%14accepted challenger▼−10Since October 2026: 10% → 0%, −10 points. Inside the 11-point floor: within noise.10% → 0%
Freshservice0%21%14accepted challenger▼−10Since October 2026: 10% → 0%, −10 points. Inside the 11-point floor: within noise.10% → 0%10
xMatters0%15%13accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
xMatters0%15%13accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%08
Grafana IRM0%11%18accepted challenger▼−7Since October 2026: 7% → 0%, −7 points. Inside the 11-point floor: within noise.7% → 0%
Grafana IRM0%11%18accepted challenger▼−7Since October 2026: 7% → 0%, −7 points. Inside the 11-point floor: within noise.7% → 0%07
Jira Service Management0%6%32accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Jira Service Management0%6%32accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
For buyers
All fifteen head-to-head pages: the top six products, each against each
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01020304050607080910111213Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative60%
Key
01incident.io47%
incident.io47%02PagerDuty25%
PagerDuty25%03Rootly9%
Rootly9%04FireHydrant4%
FireHydrant4%05Squadcast4%
Squadcast4%06Better Stack4%
Better Stack4%07Jira Service Management0%
Jira Service Management0%08Grafana IRM0%
Grafana IRM0%09Freshservice0%
Freshservice0%10xMatters0%
xMatters0%11Splunk On-Call0%
Splunk On-Call0%12ServiceNow ITSM0%
ServiceNow ITSM0%13Opsgenie0%
Opsgenie0%What they warned about
Five of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.20, DeepSeek V4 Flash, Llama 4 Maverick, MiniMax M2.5, GPT-6 Luna and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Opsgenie72%
31 of 43 labels negative · 13 of 14 models · 25 hard negative
“Atlassian ended sales for Opsgenie on June 4, 2025, and the platform is scheduled to be shut down on April 5, 2027. This makes it a risky choice” Mistral Small, negative prompt
PagerDuty21%
15 of 70 labels negative · 10 of 14 models · 1 hard negative
“Avoid or be very cautious with: Opsgenie (end-of-life), PagerDuty (cost/complexity issues)” Kimi K2, negative prompt
ServiceNow ITSM50%
12 of 24 labels negative · 8 of 14 models · 6 hard negative
“ServiceNow ITSM (if you need real-time DevOps incident response rather than enterprise ITSM workflows)” Kimi K2, negative prompt
Splunk On-Call37%
7 of 19 labels negative · 5 of 14 models · 1 hard negative
“Avoid legacy options like VictorOps (now Splunk On-Call) unless you're Splunk-heavy” Grok 4.20, paraphrase prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
75 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 819 links across 185 sites, every framing counted. Ranked by the number of answers carrying the site or page. 23 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · incident.io53 answers · 148 citations · 14 models
vendor site · Rootly29 answers · 51 citations · 12 models
vendor site · PagerDuty21 answers · 29 citations · 9 models
vendor site · G220 answers · 35 citations · 9 models
vendor site · ONES.com16 answers · 18 citations · 9 models
vendor site · Motadata15 answers · 15 citations · 8 models
vendor site · All Quiet13 answers · 13 citations · 10 models
vendor site · Instatus12 answers · 17 citations · 9 models
12 answers · 14 citations · 7 models
vendor site · ilert12 answers · 14 citations · 8 models
vendor site · ITOC36011 answers · 11 citations · 8 models
vendor site · Guideflow10 answers · 15 citations · 7 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
16 answers · 10 models
14 answers · 7 models
12 answers · 8 models
12 answers · 6 models
11 answers · 9 models
10 answers · 7 models
9 answers · 7 models
9 answers · 8 models
9 answers · 5 models
8 answers · 4 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best incident management platform”, “incident management platform”, “incident management platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| incident.io incident.io | 47% | 170 | 1,900 | 70 | 65,369 | $108 | 12 | 1 |
| PagerDuty pagerduty.com | 25% | 205 | 27,100 | 685 | 82,470 | $1,433 | 118 | |
| Rootly rootly.com | 9% | 97 | 1,900 | 30 | 13,774 | 23 | 2 | |
| FireHydrant firehydrant.com | 4% | 69 | 49,500 | 19 | 20,080 | 6 | ||
| Squadcast squadcast.com | 4% | 38 | 2,900 | 41 | 47 | |||
| Better Stack betterstack.com | 4% | 311 | 1,600 | 1,017 | 41,811 | 119 | ||
| All Quiet allquiet.app | 2% | 28 | ||||||
| Zenduty zenduty.com | 2% | 22 | 320 | 4 | 199 | 0 | ||
| ITOC360 itoc360.com | 2% | 3 | ||||||
| ONES.com ones.com | 2% | 28 | 1,300 | 0 | 145,123 |
Google's top ten for the three searches hold 18 sites; 2 of them are among the sites the models cited here (incident.io, rootly.com). The first result for “best incident management platform” is incident.io.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best incident management platform for a mid-market B2B company?”Paraphrase“Which on-call scheduling and alerting tool would you recommend to a mid-sized B2B company?”Comparative“What are the top incident management platforms and how do they differ?”Budget-constrained“What is the best incident management platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating an incident management platform. What should we look at?”Negative“Which incident management platforms should I avoid or be cautious about?”
Claude Haiku 4.5Zendutyagainst: PagerDutyPagerDutyChangedno first choiceFireHydrant, Squadcast, incident.iono first choicenothing named
Four alternatives
Freshservice, Jira Service Management, Rootly, SquadcastThree alternatives
Opsgenie, Splunk On-Call, incident.ioFive alternatives
BigPanda, Freshservice, Jira Service Management, PagerDuty, incident.ioFour alternatives
All Quiet, Jira Service Management, Spike.sh, Splunk On-CallGPT-5.4 miniPagerDutyPagerDutyHeldagainst: OpsgeniePagerDutyagainst: Opsgenieincident.iono first choiceagainst: Site24x7, Uptime.com, incident.io
Four alternatives
FireHydrant, Jira Service Management, Rootly, xMattersOne alternative
Jira Service ManagementFour alternatives
FireHydrant, Rootly, Splunk On-Call, incident.ioTwo alternatives
FireHydrant, Rootly Incident ResponseGemini 3.5 Flashincident.ioagainst: PagerDutyPagerDutyChangedPagerDutyBetter Stackagainst: Opsgenie, PagerDutyRootly, incident.ioagainst: Better Stack, PagerDuty, Splunk On-Callagainst: BMC Helix / Remedy, Opsgenie, PagerDuty, ServiceNow ITSM
Three alternatives
FireHydrant, Jira Service Management, RootlyFour alternatives
Better Stack, Opsgenie, Rootly, incident.ioSeven alternatives
Atlassian, Datadog Incident Management, FireHydrant, Jira Service Management, Rootly, ServiceNow ITSM, incident.ioFive alternatives
GoAlert, Grafana IRM, Pulsetic, Spike.sh, SquadcastTwo alternatives
FireHydrant, Jira Service ManagementPerplexity SonarPagerDutyagainst: ServiceNow ITSMincident.ioChangedagainst: OnPage, Splunk On-CallPagerDutyincident.ioagainst: PagerDutyno first choiceagainst: AlertOps, Datadog, Grafana, Opsgenie, PagerDuty, Rootly, Splunk, incident.io
Five alternatives
Better Stack, Freshservice, Jira Service Management, Squadcast, incident.ioTwo alternatives
Better Stack, PagerDutyEight alternatives
Better Stack, BigPanda, Freshservice, Grafana Incident, Jira Service Management, Rootly, ServiceNow ITSM, incident.ioThree alternatives
Better Stack, Jira Service Management, ZendutyGrok 4.20Rootly, incident.ioagainst: ServiceNow ITSMSquadcastChangedagainst: Opsgenie, PagerDuty, Splunk On-CallRootly, incident.ioagainst: Opsgenieincident.ioagainst: AlertMedia, BigPanda, ServiceNow ITSMno first choiceagainst: ServiceNow ITSMagainst: BMC, BigPanda, New Relic, Opsgenie, Remedy, ServiceNow ITSM, Splunk On-Call, xMatters
Three alternatives
Freshservice, Jira Service Management, PagerDutyOne alternative
FireHydrantTwo alternatives
PagerDuty, ServiceNow ITSMFour alternatives
Better Stack, Opsgenie, PagerDuty, Site24x7Mistral Smallincident.ioincident.ioHeldincident.ioagainst: Freshservice, Opsgenie, ServiceNow IT Service, ZendeskAll Quiet, PagerDutyno first choiceagainst: Freshservice, Grafana IRM, Opsgenie
One alternative
PagerDutyFour alternatives
BigPanda, FireHydrant, Jira Service Management, Spike.shOne alternative
AlertOpsDeepSeek V4 Flashincident.ioagainst: OpsgeniePagerDuty, RootlyChangedagainst: Opsgenie, Splunk On-CallPagerDuty, Rootly, incident.ioagainst: OpsgeniePagerDutyagainst: FireHydrant, OpsgeniePagerDutyagainst: ServiceNow ITSMagainst: BMC Helix ITSM, BMC Remedy, FireHydrant, Jira Service Management, ManageEngine, Opsgenie, PagerDuty, ServiceNow ITSM, Splunk On-Call
Four alternatives
FireHydrant, PagerDuty, Rootly, SquadcastFour alternatives
AlertOps, FireHydrant, Grafana IRM, incident.ioFour alternatives
BigPanda, Grafana IRM, Jira Service Management, ServiceNow ITSMThree alternatives
AlertOps, Better Stack, incident.ioFour alternatives
FireHydrant, Grafana IRM, Rootly, incident.ioLlama 4 Maverickincident.iono first choiceChangedno first choicePagerDutyno first choiceagainst: Opsgenie
Three alternatives
Freshservice, PagerDuty, SquadcastFour alternatives
All Quiet, Freshservice, ONES Project, incident.ioQwen 3.7 Flashincident.ioincident.ioHeldPagerDuty, Splunk On-CallPagerDutyagainst: OpsgenieFireHydrant, PagerDuty, Rootly, incident.ioagainst: Freshservice, Jira Service Management, PagerDuty, ServiceNow ITSM, xMatters
Two alternatives
Opsgenie, PagerDutyThree alternatives
PagerDuty, Spike.sh, SquadcastSeven alternatives
Datadog, FireHydrant, Jira Service Management, Rootly, ServiceNow ITSM, Site24x7, incident.ioThree alternatives
All Quiet, Splunk On-Call, incident.ioTwo alternatives
Datadog IRM, Jira Service ManagementKimi K2incident.ioagainst: Opsgenieincident.ioHeldagainst: Grafana IRMPagerDuty, Rootly, incident.ioagainst: OpsgenieONES.comagainst: Cabot, GoAlertno first choiceagainst: Opsgenie, PagerDuty, ServiceNow ITSM
Three alternatives
FireHydrant, PagerDuty, RootlyTwo alternatives
Opsgenie, PagerDutyFour alternatives
Datadog, FireHydrant, Grafana IRM, ServiceNow ITSMFour alternatives
Opsgenie, Squadcast, Zenduty, incident.ioGLM 4.7 FlashXincident.ioincident.ioHeldPagerDutyagainst: OpsgenieRootly, incident.ioagainst: OTRS, Spiceworksno first choiceagainst: CrowdStrike
Three alternatives
Jira Service Management, PagerDuty, ServiceNow ITSMFour alternatives
Instatus, PagerDuty, PagerTree, SquadcastFour alternatives
Instatus, Rootly, ServiceNow ITSM, incident.ioSix alternatives
Grafana IRM, Jira Service Management, Keep, Opsgenie, PagerDuty, SquadcastMiniMax M2.5incident.ioITOC360, RunframeChangedagainst: PagerDutyPagerDuty, Rootlyagainst: Opsgenie, ServiceNow ITSMBetter Stack, incident.ioagainst: Opsgenie, PagerDutyno first choicenothing named
Two alternatives
FireHydrant, RootlyOne alternative
incident.ioTwo alternatives
incident.io, xMattersOne alternative
Grafana IRMGPT-6 Lunaincident.ioPagerDutyChangedagainst: OpsgeniePagerDutyagainst: Opsgenieincident.iono first choiceagainst: Opsgenie, PagerDuty
Two alternatives
PagerDuty, RootlyTwo alternatives
Jira Service Management, incident.ioSix alternatives
Better Stack, FireHydrant, Jira Service Management, Rootly, ServiceNow ITSM, incident.ioOne alternative
PagerDutyMuse Glimmer 30Bincident.ioagainst: OpsgeniePagerDuty, incident.ioChangedagainst: OpsgeniePagerDuty, incident.ioagainst: Opsgenieincident.ioagainst: Opsgenieno first choiceagainst: BMC Remedy, FireHydrant, Opsgenie, PagerDuty, ServiceNow ITSM, Splunk On-Call
Seven alternatives
All Quiet, FireHydrant, OnPage, PagerDuty, Rootly, SolarWinds IT Incident Response, formerly Squadcast, ZendutyFour alternatives
Better Stack, Grafana IRM, Spike.sh, SquadcastEight alternatives
AlertOps, Better Stack, Datadog Incident Response, FireHydrant, Grafana IRM, OnPage, Rootly, xMatters, now EverbridgeFive alternatives
Better Stack, Grafana IRM, PagerDuty, Spike.sh, SquadcastBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 19:10 | yes | 19 | 9 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 17:19 | yes | 5 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 11:37 | no | 0 | 19 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 13:53 | yes | 10 | 4 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 16:23 | yes | 15 | 16 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 12:15 | yes | 5 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 16:32 | yes | 23 | 40 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:04 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 16:51 | no | 0 | 30 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 09:41 | yes | 20 | 27 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 13:35 | yes | 15 | 85 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 08:39 | yes | 15 | 37 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 14:23 | yes | 3 | 15 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 14:22 | yes | 15 | 21 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 10:41 | no | 0 | 4 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 09:16 | yes | 2 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 10:09 | no | 0 | 15 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 08:49 | yes | 10 | 4 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:50 | yes | 9 | 14 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 13:05 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:27 | yes | 20 | 21 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 14:50 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 09:25 | yes | 5 | 17 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 12:45 | yes | 19 | 25 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 16:34 | yes | 14 | 18 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:54 | yes | 5 | 24 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 10:34 | yes | 3 | 16 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 15:58 | yes | 15 | 20 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 17:53 | yes | 9 | 7 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 12:51 | yes | 7 | 8 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 19:20 | yes | 13 | 24 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 17:42 | yes | 10 | 6 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 16:26 | yes | 5 | 19 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 17:53 | yes | 5 | 8 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 15:33 | yes | 24 | 46 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 19:28 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 12:05 | yes | 5 | 24 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 10:42 | yes | 14 | 44 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:52 | yes | 25 | 262 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 13:51 | yes | 20 | 63 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 11:37 | yes | 7 | 19 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 18:49 | yes | 13 | 23 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 19:13 | yes | 16 | 8 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 10:27 | yes | 3 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 17:23 | yes | 7 | 23 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 12:04 | yes | 10 | 4 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 14:45 | yes | 5 | 11 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 16:51 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 09:13 | yes | 25 | 23 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:12 | yes | 5 | 3 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 17:36 | yes | 5 | 20 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 16:08 | yes | 10 | 47 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 16:15 | yes | 10 | 256 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:47 | yes | 14 | 54 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 09:52 | yes | 2 | 13 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 11:38 | yes | 14 | 32 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 12:09 | yes | 18 | 14 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 14:47 | yes | 5 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 15:18 | no | 0 | 19 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 19:04 | yes | 10 | 8 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:10 | yes | 5 | 15 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 14:51 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 11:05 | yes | 23 | 54 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 17:51 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 12:02 | yes | 5 | 31 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 17:15 | yes | 13 | 25 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 18:20 | yes | 14 | 25 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 12:21 | yes | 10 | 73 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 08:35 | yes | 2 | 14 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 16:17 | no | 0 | 4 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 09:17 | no | 0 | 3 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 08:58 | yes | 3 | 5 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 19:42 | yes | 5 | 19 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 11:31 | yes | 10 | 4 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:40 | yes | 5 | 13 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 16:10 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 17:28 | yes | 24 | 40 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:59 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 16:02 | yes | 20 | 44 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 11:05 | yes | 25 | 21 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 14:51 | yes | 25 | 195 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 11:34 | no | 0 | 22 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 12:49 | yes | 2 | 14 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 19:07 | yes | 25 | 32 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
BMC Helix read as BMC Helix ITSM
ServiceNow read as ServiceNow ITSM
ServiceNow IT Service Management read as ServiceNow ITSM
ServiceNow IT Service Management (ITSM) read as ServiceNow ITSM
ServiceNow ITSM Incident Management read as ServiceNow ITSM
Unresolved, counted raw
Cabot
Datadog IRM
FireHydra
Fliplet
Grafana Incident
New Relic Incident Management
OnCallAlerting
RT (Request Tracker)
Rootly Incident Response
ServiceNow IT Service
SolarWinds IT Incident Response, formerly Squadcast
Splunk On-Call, formerly VictorOps
Discontinued, still offered
No shut-down product was recommended here.