Penetration testing as a service for enterprise buyers
Asked as “penetration testing service”, and as “pentest-as-a-service provider”, on behalf of an enterprise B2B company. 50 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
30%
Contested · Synack 16%
30NetSPI16Synack12Bishop Fox42others
30% of first choices, contested.
Since October 2026▼−16Since October 2026: 46% → 30%, −16 points. Past the 11-point floor: movement.NetSPI held the lead, −16 points on 46%, past the floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Stingrai22%Contested↗new leaderNew leader since October 2026: Stingrai (22%) replaces Cobalt (17% then, 13% now), 9 points clear, inside the 11-point floor.Standing →Mid-market
Cobalt46%Clear leader▲+1Since October 2026: 45% → 46%, +1 point. Inside the 11-point floor: within noise.Standing →Enterprise
NetSPI30%Contested▼−16Since October 2026: 46% → 30%, −16 points. Past the 11-point floor: movement.This page
Stingrai22%Contested↗new leaderNew leader since October 2026: Stingrai (22%) replaces Cobalt (17% then, 13% now), 9 points clear, inside the 11-point floor.Standing →Mid-marketCobalt46%Clear leader▲+1Since October 2026: 45% → 46%, +1 point. Inside the 11-point floor: within noise.Standing →EnterpriseNetSPI30%Contested▼−16Since October 2026: 46% → 30%, −16 points. Past the 11-point floor: movement.This pageThe standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01NetSPI30%3%39endorsed leader▼−16Since October 2026: 46% → 30%, −16 points. Past the 11-point floor: movement.46% → 30%
NetSPI30%3%39endorsed leader▼−16Since October 2026: 46% → 30%, −16 points. Past the 11-point floor: movement.46% → 30%02
Synack16%5%41accepted challenger▼−7Since October 2026: 23% → 16%, −7 points. Inside the 11-point floor: within noise.23% → 16%
Synack16%5%41accepted challenger▼−7Since October 2026: 23% → 16%, −7 points. Inside the 11-point floor: within noise.23% → 16%03Cobalt12%6%48accepted challenger=heldSince October 2026: 12% → 12%, ±0 points. Inside the 11-point floor: within noise.12% → 12%
Cobalt12%6%48accepted challenger=heldSince October 2026: 12% → 12%, ±0 points. Inside the 11-point floor: within noise.12% → 12%04
Bishop Fox12%6%31accepted challenger▲+8Since October 2026: 4% → 12%, +8 points. Inside the 11-point floor: within noise.4% → 12%
Bishop Fox12%6%31accepted challenger▲+8Since October 2026: 4% → 12%, +8 points. Inside the 11-point floor: within noise.4% → 12%05
NCC Group2%4%25accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%
NCC Group2%4%25accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%06
Mandiant Lab in the set2%0%17accepted challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%
Mandiant Lab in the set2%0%17accepted challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%07
Rapid72%0%15accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%
Rapid72%0%15accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%08
BreachLock2%0%14accepted challenger▼−4Since October 2026: 6% → 2%, −4 points. Inside the 11-point floor: within noise.6% → 2%
BreachLock2%0%14accepted challenger▼−4Since October 2026: 6% → 2%, −4 points. Inside the 11-point floor: within noise.6% → 2%09IBM X-Force Red2%0%11accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%
Show the three products at 0%, ordered by negative rate
11HackerOne PTaaS0%16%19accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
10
Coalfire0%6%18accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Coalfire0%6%18accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Mandiant is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models one time of 52. Lab treatment is defined on the method page; the row is marked, not excluded.
For buyers
Head to headHead-to-head pages are published for mid-market buyers, so these open on mid-market figures, not enterprise.
All twenty-eight head-to-head pages: the top eight products, each against each
Cobalt vs NetSPICobalt vs Bishop FoxCobalt vs IntruderCobalt vs RaxisAstra Security vs BreachLockAstra Security vs StingraiAstra Security vs NetSPIAstra Security vs Bishop FoxAstra Security vs IntruderAstra Security vs RaxisBreachLock vs StingraiBreachLock vs NetSPIBreachLock vs Bishop FoxBreachLock vs IntruderBreachLock vs RaxisStingrai vs NetSPIStingrai vs Bishop FoxStingrai vs IntruderStingrai vs RaxisNetSPI vs Bishop FoxNetSPI vs IntruderNetSPI vs RaxisBishop Fox vs IntruderBishop Fox vs RaxisIntruder vs Raxis
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
0102030405060708I09
10H11
12Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01NetSPI30%
NetSPI30%02Synack16%
Synack16%03Cobalt12%
Cobalt12%04Bishop Fox12%
Bishop Fox12%05NCC Group2%
NCC Group2%06Mandiant2%
Mandiant2%07Rapid72%
Rapid72%08BreachLock2%
BreachLock2%09IBM X-Force Red2%
10Coalfire0%
Coalfire0%11HackerOne PTaaS0%
12Praetorian0%
Praetorian0%What they warned about
Three of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, Gemini 3.5 Flash, Grok 4.20, Mistral Small, DeepSeek V4 Flash, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX, MiniMax M2.5, GPT-6 Luna and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Cobalt6%
3 of 48 labels negative · 3 of 14 models
“Cobalt: Uses a credit-based model that requires active management to avoid credit expiration, which can be less predictable.” Llama 4 Maverick, negative prompt
HackerOne PTaaS
16%
3 of 19 labels negative · 3 of 14 models
“Crowdsourced testing and PTaaS provide broad researcher reach, but consistency and tester specialization should be governed carefully for sensitive enterprise scopes.” Perplexity Sonar, comparative prompt
Tenable Nessus100%
3 of 3 labels negative · 2 of 14 models · 1 hard negative
“Avoid purely automated scanners (e.g., basic Nessus) for enterprises” Grok 4.20, direct prompt
Bugcrowd PTaaS
22%
2 of 9 labels negative · 2 of 14 models
“crowdsourced penetration testing platforms like Bugcrowd, HackerOne, and Synack can be powerful for certain use cases, but they are not universally suitable for large enterprises” Llama 4 Maverick, negative prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
71 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 822 links across 260 sites, every framing counted. Ranked by the number of answers carrying the site or page. 11 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · Synack35 answers · 67 citations · 14 models
vendor site · Stingrai34 answers · 59 citations · 12 models
18 answers · 18 citations · 7 models
vendor site · Cloud Security Partners16 answers · 16 citations · 8 models
vendor site · Cybri15 answers · 18 citations · 9 models
vendor site · DeepStrike14 answers · 16 citations · 6 models
vendor site · Atlant Security14 answers · 14 citations · 8 models
12 answers · 12 citations · 8 models
vendor site · Cobalt11 answers · 20 citations · 6 models
vendor site · Software Secured11 answers · 15 citations · 6 models
vendor site · VerSprite11 answers · 11 citations · 7 models
vendor site · Netragard10 answers · 10 citations · 7 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
18 answers · 7 models
15 answers · 8 models
14 answers · 10 models
12 answers · 8 models
12 answers · 9 models
11 answers · 7 models
10 answers · 6 models
9 answers · 7 models
9 answers · 3 models
8 answers · 5 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best penetration testing service”, “penetration testing service”, “penetration testing services”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| NetSPI netspi.com | 30% | 67 | 1,900 | 58 | 4,142 | $336 | 43 | |
| Synack synack.com | 16% | 66 | 2,400 | 59 | 6,764 | 7 | 4 | |
| Cobalt cobalt.io | 12% | 127 | 135,000 | 27,732 | 23,655 | 14 | ||
| Bishop Fox bishopfox.com | 12% | 44 | 1,600 | 18 | 23,962 | 1 | ||
| Invicti invicti.com | 6% | 161 | 90,500 | 83 | 54,568 | $50 | 24 | |
| NCC Group nccgroup.com | 2% | 32 | 1,300 | 79 | 3,182 | 10 | ||
| Mandiant cloud.google.com | 2% | 26 | 6,600 | 253 | 7,405,347 | |||
| Rapid7 rapid7.com | 2% | 63 | 14,800 | 798 | 123,299 | $609 | 30 | 3 |
| BreachLock breachlock.com | 2% | 81 | 590 | 6 | 2,479 | 22 | ||
| IBM parent site IBM X-Force Red 2% | 2% | 12 | 201,000 | 34,098 |
Google's top ten for the three searches hold 22 sites; 2 of them are among the sites the models cited here (cybri.com, synack.com). The first result for “best penetration testing service” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best penetration testing service for an enterprise B2B company?”Paraphrase“Which pentest-as-a-service provider would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade penetration testing services and how do they differ?”Budget-constrained“What is the best penetration testing service for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a penetration testing service. What should we look at?”Negative“Which penetration testing services should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5no first choiceNetSPIChangedagainst: Cobaltno first choiceInvictiagainst: NetSPIno first choicenothing named
One alternative
SynackFive alternatives
Bishop Fox, Mandiant, NCC Group, NetSPI, SynackOne alternative
CobaltGPT-5.4 miniCobaltagainst: InvictiCobaltHeldCobalt, SynackCobaltno first choicenothing named
Two alternatives
HackerOne PTaaS, NetSPIThree alternatives
BreachLock, NetSPI, SynackSix alternatives
Bishop Fox, Coalfire, CrowdStrike, HackerOne PTaaS, Rapid7, SpecterOpsGemini 3.5 FlashCobaltNetSPIChangedno first choiceBreachLockno first choicenothing named
Seven alternatives
Bishop Fox, Bugcrowd PTaaS, HackerOne PTaaS, Mandiant, NCC Group, Palo Alto Networks, SynackFour alternatives
Bugcrowd PTaaS, Cobalt, HackerOne PTaaS, SynackTen alternatives
Bishop Fox, Cobalt, CrowdStrike Services, Deloitte, Mandiant, NCC Group, NetSPI, Palo Alto Networks, PwC, SynackFour alternatives
Bishop Fox, Cobalt, Pentera, SynackPerplexity SonarNetSPIagainst: Packetlabs, Software SecuredNetSPIHeldNetSPIagainst: HackerOne PTaaSNetSPIno first choicenothing named
Four alternatives
Bishop Fox, Cobalt, Mandiant, SynackThree alternatives
Cobalt, Rapid7, SynackEight alternatives
Bishop Fox, Coalfire, Cobalt, IBM X-Force Red, Mandiant, NCC Group, Rapid7, SynackTwo alternatives
Cobalt, SynackGrok 4.20Bishop Foxagainst: Tenable NessusSynackChangedBishop Fox, NCC Group, NetSPISynackagainst: Coalfire, NCC Groupno first choiceagainst: Big 4 Firms, Burp Suite, OpenVAS, Tenable Nessus
Four alternatives
Bugcrowd PTaaS, Cobalt, NetSPI, Rapid7Four alternatives
BreachLock, Cobalt, HackerOne PTaaS, NetSPIFive alternatives
BreachLock, Cobalt, IBM X-Force Red, Optiv, PraetorianThree alternatives
Bishop Fox, Cobalt, NetSPIMistral SmallBishop Fox, CybriNetSPIChangedno first choiceStingrai, Synackno first choiceagainst: Bugcrowd PTaaS, HackerOne PTaaS, Synack
Two alternatives
BreachLock, Rapid7Two alternatives
HackerOne PTaaS, MandiantThree alternatives
Coalfire, NCC Group, NetSPIDeepSeek V4 FlashBishop FoxNetSPIChangedagainst: Bishop Fox, CobaltCobalt, NetSPIagainst: Acunetix, Deloitte, EY, Intruder, KPMG, PwCSprocket Securityagainst: Astra Security, Bishop Fox, Intruderno first choicenothing named
Four alternatives
IBM X-Force Red, Mandiant, NCC Group, NetSPIOne alternative
SynackSeven alternatives
Bishop Fox, Coalfire, CrowdStrike, IBM X-Force Red, Mandiant, NCC Group, SynackOne alternative
CobaltLlama 4 MaverickNetSPINetSPIHeldno first choiceSynackno first choiceagainst: Bugcrowd PTaaS, Cobalt, HackerOne PTaaS, Synack
Two alternatives
Cobalt, SynackThree alternatives
Cobalt, HackerOne PTaaS, NetSPIQwen 3.7 FlashMandiantCobaltChangedStingraiCobaltagainst: Qualys, Tenable Vulnerability Managementno first choiceagainst: Deloitte, EY, KPMG, OpenVAS, PwC, Qualys, Tenable Nessus
Six alternatives
Bishop Fox, Cobalt Security, Deloitte, KPMG, PwC, Verode TechnologiesThree alternatives
Bugcrowd PTaaS, Synack, UpwaveEight alternatives
Bishop Fox, Coalfire, GuidePoint Security, IBM X-Force Red, Kroll, NCC Group, NetSPI, PraetorianThree alternatives
Pentera, Positive Technologies, SecureLayer7Kimi K2Bishop Fox, DeloitteNetSPIChangedno first choiceBugcrowd PTaaS Subscriptionno first choicenothing named
Four alternatives
BreachLock, Coalfire, Cobalt, MandiantTwo alternatives
Cobalt, SynackNine alternatives
Bishop Fox, Bugcrowd PTaaS, Coalfire, Cobalt, HackerOne PTaaS, Mandiant, NCC Group, NetSPI, SynackTwo alternatives
Cobalt, SynackThree alternatives
Apviso, Cobalt, SynackGLM 4.7 FlashXInvicti, Rapid7NetSPIChangedNetSPISynackno first choicenothing named
Four alternatives
Bishop Fox, Coalfire, Cobalt, NCC GroupTwo alternatives
Cobalt, SynackFive alternatives
Bishop Fox, Coalfire, IBM X-Force Red, NCC Group, PraetorianThree alternatives
Cobalt, NetSPI, Rapid7MiniMax M2.5Astra Security, InvictiNetSPI, SynackChangedNetSPISynackno first choicenothing named
Three alternatives
Bishop Fox, Cybri, Rapid7Two alternatives
BreachLock, CobaltFourteen alternatives
Bishop Fox, Coalfire, Cobalt, HackerOne PTaaS, IBM X-Force Red, IOActive, Kroll, Mandiant, NCC Group, Praetorian, Rapid7, SpecterOps, Synack, TrustedSecGPT-6 LunaBishop FoxSynackChangedno first choiceHorizon3.ai NodeZero Coreno first choicenothing named
Two alternatives
Cobalt, NCC GroupOne alternative
CobaltOne alternative
CobaltMuse Glimmer 30BBishop Fox, IBM X-Force Red, NCC Group, NetSPINetSPIChangedno first choiceNetSPIno first choiceagainst: Qualys, Trustwave
Seven alternatives
Coalfire, GuidePoint Security, Kroll, Optiv, Praetorian, Stingrai, TrustedSecThree alternatives
BreachLock, Cobalt, InvictiNine alternatives
Bishop Fox, Coalfire, Cobalt, Mandiant, NCC Group, NetSPI, Rapid7, Stingrai, SynackSix alternatives
Continuous Security subscription model, CoreCyber, Penti.ai Manual Pentest, Synack, ThreatSpike Labs, TurboPentestBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 09:33 | no | 0 | 5 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 18:08 | yes | 5 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 09:09 | no | 0 | 15 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 17:11 | yes | 10 | 4 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 19:08 | yes | 5 | 14 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 16:43 | yes | 5 | 26 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:02 | yes | 22 | 48 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 14:09 | yes | 5 | 3 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 09:59 | no | 0 | 30 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 13:07 | yes | 15 | 60 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:02 | yes | 13 | 25 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 13:04 | yes | 5 | 21 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 14:54 | yes | 3 | 9 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 10:05 | yes | 13 | 15 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 15:24 | yes | 17 | 10 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 09:01 | yes | 5 | 4 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 09:51 | yes | 9 | 20 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 16:58 | yes | 10 | 4 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 14:13 | yes | 10 | 9 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 18:18 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 09:38 | yes | 25 | 19 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 18:20 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:21 | no | 0 | 31 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 11:34 | yes | 20 | 22 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 08:46 | yes | 19 | 43 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 15:31 | yes | 24 | 39 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 13:46 | yes | 2 | 12 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 14:00 | yes | 23 | 25 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 15:21 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 17:12 | yes | 9 | 10 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 15:58 | no | 0 | 20 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 15:06 | yes | 10 | 7 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 16:25 | yes | 5 | 18 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 12:56 | yes | 9 | 13 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 15:29 | yes | 21 | 45 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 17:24 | yes | 5 | 4 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 11:27 | yes | 5 | 22 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 18:10 | yes | 17 | 34 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 14:59 | yes | 23 | 109 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 17:20 | yes | 17 | 52 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 14:38 | yes | 8 | 24 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 10:17 | yes | 13 | 27 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 10:04 | yes | 18 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 19:14 | yes | 1 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 11:53 | no | 0 | 15 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 11:29 | yes | 10 | 3 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:47 | yes | 5 | 9 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 11:50 | yes | 5 | 6 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:30 | yes | 24 | 20 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 16:13 | yes | 5 | 4 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 12:03 | no | 0 | 24 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 14:16 | yes | 19 | 36 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:50 | yes | 25 | 201 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 12:24 | yes | 5 | 28 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 11:41 | yes | 2 | 16 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 08:37 | yes | 25 | 38 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 10:49 | yes | 18 | 17 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 15:32 | yes | 3 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 18:47 | no | 0 | 19 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 12:03 | yes | 10 | 8 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 14:51 | yes | 5 | 14 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 11:26 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 13:15 | yes | 23 | 28 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 08:47 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 11:36 | yes | 5 | 37 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 16:20 | yes | 20 | 39 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 18:08 | yes | 15 | 39 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 14:33 | no | 0 | 30 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 11:39 | yes | 5 | 23 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 17:36 | yes | 15 | 23 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 19:32 | no | 0 | 5 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 19:27 | yes | 8 | 8 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 16:16 | no | 0 | 17 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 15:36 | yes | 10 | 5 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:46 | yes | 5 | 15 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 19:34 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 17:15 | yes | 24 | 38 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 10:37 | yes | 5 | 4 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 11:34 | yes | 5 | 32 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 14:25 | yes | 25 | 31 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 08:57 | yes | 24 | 84 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 13:01 | no | 0 | 94 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 12:17 | yes | 4 | 10 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 16:18 | yes | 13 | 31 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Astra read as Astra Security
Bugcrowd read as Bugcrowd PTaaS
HackerOne read as HackerOne PTaaS
HackerOne Pentest read as HackerOne PTaaS
Horizon3.ai (NodeZero) read as Horizon3.ai NodeZero
Unresolved, counted raw
Apviso
Axipro
Big 4 Firms
Blue Goat Cyber
Bugcrowd PTaaS Subscription
Cobalt Security
Continuous Security subscription model
Cure53
Horizon3.ai NodeZero Core
Insight Assurance
Netguru
Penti.ai Manual Pentest
Positive Technology
Sekurno
ThreatSpike Labs
Trail of Bits
Upwave
Verode Technologies
White Knight Labs
Discontinued, still offered
No shut-down product was recommended here.