Static application security testing
Asked as “SAST tool”, and as “static code security scanner”, on behalf of a mid-market B2B company. 45 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
47%
Clear leader
47Semgrep AppSec Platform22SonarQube13Snyk Code18others
47% of first choices, clear leader.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the five products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Head to head
All fifteen head-to-head pages: the top six products, each against each
Semgrep AppSec Platform vs CodeQLSemgrep AppSec Platform vs Veracode Static AnalysisSonarQube vs Snyk CodeSonarQube vs Aikido SecuritySonarQube vs CodeQLSonarQube vs Veracode Static AnalysisSnyk Code vs Aikido SecuritySnyk Code vs CodeQLSnyk Code vs Veracode Static AnalysisAikido Security vs CodeQLAikido Security vs Veracode Static AnalysisCodeQL vs Veracode Static Analysis
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
S01
S02
03
04C05
06
07g08
B09
10
11Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative60%
Key
01Semgrep AppSec Platform47%
02SonarQube22%
03Snyk Code13%
Snyk Code13%04Aikido Security4%
Aikido Security4%05CodeQL2%
06Veracode Static Analysis2%
Veracode Static Analysis2%07GitHub Advanced Security0%
GitHub Advanced Security0%08gosec0%
09Bandit0%
10Checkmarx One0%
Checkmarx One0%11OpenText Fortify0%
OpenText Fortify0%What they warned about
Two of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Perplexity Sonar, Grok 4.20, Mistral Small, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Checkmarx One48%
22 of 46 labels negative · 9 of 12 models · 4 hard negative
“Tools to Avoid on a Tight Budget ... Checkmarx One / Fortify / Vercode: These are enterprise-grade tools” Qwen 3.7 Flash, budget prompt
Veracode Static Analysis40%
14 of 35 labels negative · 7 of 12 models · 5 hard negative
“Avoid legacy, binary-upload scanners... historically pioneered by tools like Veracode)... a major friction point for modern, fast-paced DevSecOps teams.” Gemini 3.5 Flash, negative prompt
OpenText Fortify52%
12 of 23 labels negative · 7 of 12 models · 3 hard negative
“High-cost, legacy platforms (like OpenText Fortify or older on-premise setups of Checkmarx)... Avoid legacy, binary-upload scanners and heavyweight on-premise engines.” Gemini 3.5 Flash, negative prompt
SonarQube
10%
5 of 48 labels negative · 5 of 12 models
“SonarQube: High false positive rates out-of-the-box (40-82% ...) ... Tune heavily or pair with security-specific tools.” Grok 4.20, negative prompt
What they cite
Twelve of the twelve models returned a source list in this edition: four return the pages they cited and eight the search results they consulted.
Sites the answers cite
63 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 795 links across 146 sites, every framing counted. Ranked by the number of answers carrying the site or page.
vendor site · ZeroPath35 answers · 37 citations · 11 models
34 answers · 46 citations · 11 models
vendor site · Corgea34 answers · 38 citations · 12 models
30 answers · 47 citations · 11 models
vendor site · Endor Labs24 answers · 35 citations · 9 models
vendor site · Augment Code24 answers · 27 citations · 10 models
vendor site · Pixee24 answers · 25 citations · 9 models
vendor site · OX23 answers · 24 citations · 10 models
vendor site · Checkmarx20 answers · 26 citations · 8 models
vendor site · Cycode19 answers · 20 citations · 8 models
vendor site · Safeguard16 answers · 22 citations · 9 models
14 answers · 14 citations · 8 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
34 answers · 11 models
31 answers · 11 models
24 answers · 9 models
24 answers · 10 models
23 answers · 10 models
21 answers · 9 models
19 answers · 8 models
14 answers · 8 models
13 answers · 7 models
13 answers · 9 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best sast tool”, “sast tool”, “sast tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days |
|---|---|---|---|---|---|---|---|
| Semgrep AppSec Platform semgrep.dev | 47% | 167 | 3,461 | 43 | |||
| SonarQube | 22% | 14,800 | 1,353 | ||||
| Snyk snyk.io Snyk Code 13%, Snyk 7% | 20% | 150 | 12,100 | 581 | 61,651 company | 60 | |
| Aikido aikido.dev Aikido Security 4% | 4% | 326 | 2,400 | 51 | 6,442 company | $936 | 120 |
| CodeQL | 2% | 2,900 | 81 | ||||
| CodeAnt AI codeant.ai | 2% | 18 | 260 | 9 | 2,282 | $472 | 56 |
| Veracode Static Analysis veracode.com | 2% | 100 | 40 | 2 | 12,543 | 17 | |
| GitHub parent site GitHub Advanced Security 0% | 0% | 78 | 1,500,000 | 31,479 | |||
| gosec | 0% | 170 | 5 | ||||
| GitLab parent site GitLab SAST 0% | 0% | 24 | 90,500 | 4,844 |
Google's top ten for the three searches hold 24 sites; 4 of them are among the sites the models cited here (checkmarx.com, endorlabs.com, safeguard.sh, zeropath.com). The first result for “best sast tool” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best SAST tool for a mid-market B2B company?”Paraphrase“Which static code security scanner would you recommend to a mid-sized B2B company?”Comparative“What are the top SAST tools and how do they differ?”Budget-constrained“What is the best SAST tool for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a SAST tool. What should we look at?”Negative“Which SAST tools should I avoid or be cautious about?”
Claude Haiku 4.5no first choiceSnyk, SonarQubeChangedno first choiceSemgrep AppSec Platform, SonarQubeno first choicenothing named
Three alternatives
Checkmarx One, GitHub Advanced Security, Semgrep AppSec PlatformFive alternatives
Checkmarx One, Corgea, OpenText Fortify, Snyk Code, Veracode Static AnalysisOne alternative
CodacyGPT-5.4 miniSnyk CodeSemgrep AppSec PlatformChangedagainst: Checkmarx One, OpenText FortifyCheckmarx One, HCL AppScan, Veracode Static Analysisagainst: Contrast AssessCodeQLno first choicenothing named
Three alternatives
Checkmarx One, GitHub Advanced Security, Veracode Static AnalysisOne alternative
CodeQLFour alternatives
Black Duck Coverity, Semgrep AppSec Platform, Snyk Code, SonarQubeOne alternative
Semgrep AppSec PlatformGemini 3.5 FlashAikido Securityagainst: Checkmarx One, OpenText Fortify, Veracode Static AnalysisAikido SecurityHeldagainst: Checkmarx One, GitHub Advanced Security, Snyk, Veracode Static Analysisno first choiceSemgrep AppSec PlatformSemgrep AppSec Platform, Snykagainst: Checkmarx One, Veracode Static Analysisagainst: Bandit, Checkmarx One, OpenText Fortify, Snyk Code, Veracode Static Analysis
Four alternatives
GitHub Advanced Security, GitLab SAST, Semgrep AppSec Platform, SnykTwo alternatives
GitLab SAST, Semgrep AppSec PlatformFive alternatives
Checkmarx One, GitHub Advanced Security, Semgrep AppSec Platform, Snyk Code, Veracode Static AnalysisSix alternatives
Aikido Security, Bandit, Brakeman, SonarQube, SpotBugs/FindSecBugs, gosecThree alternatives
Aikido Security, GitHub Advanced Security, SonarQubePerplexity SonarCodeAnt AIVeracode Static AnalysisChangedCheckmarx One, Veracode Static Analysisagainst: OpenText FortifySemgrep AppSec Platformagainst: Checkmarx One, Veracode Static Analysisno first choiceagainst: Bandit, Brakeman, CodeQL
Two alternatives
Aikido Security, Semgrep AppSec PlatformTwo alternatives
Aikido Security, Semgrep AppSec PlatformFour alternatives
Aikido Security, CodeQL, Semgrep AppSec Platform, Snyk CodeFive alternatives
Bandit, CodeAnt AI, Qodana, SonarQube, gosecGrok 4.20Semgrep AppSec Platformagainst: Checkmarx OneSonarQubeChangedagainst: Checkmarx One, Veracode Static AnalysisCheckmarx One, Snyk CodeSemgrep AppSec Platformno first choiceagainst: Checkmarx One, OpenText Fortify, SonarQube
Two alternatives
Snyk Code, SonarQubeTwo alternatives
Semgrep AppSec Platform, Snyk CodeFour alternatives
CodeQL, Semgrep AppSec Platform, SonarQube, Veracode Static AnalysisThree alternatives
Bandit, CodeQL, SonarQubeFour alternatives
Checkmarx One, Semgrep AppSec Platform, Snyk Code, SonarQubeMistral SmallSemgrep AppSec PlatformSonarQubeChangedSemgrep AppSec PlatformSemgrep AppSec Platformno first choicenothing named
Two alternatives
CodeAnt AI, SonarQubeThree alternatives
Checkmarx One, GitHub Advanced Security, Snyk CodeSeven alternatives
Checkmarx One, Cycode, GitLab SAST, Snyk Code, SonarQube, Veracode Static Analysis, ZeroPathFive alternatives
Bandit, Brakeman, CodeQL, SonarQube, gosecDeepSeek V4 FlashSemgrep AppSec PlatformSemgrep AppSec PlatformHeldagainst: Checkmarx One, SonarQube, Veracode Static Analysisno first choiceSemgrep AppSec Platformagainst: Checkmarx One, CodeQL, Veracode Static AnalysisSemgrep AppSec Platformagainst: Checkmarx One, OpenText Fortify, Veracode Static Analysisagainst: Checkmarx One, OpenText Fortify, Veracode Static Analysis
Five alternatives
Checkmarx One, GitHub Advanced Security, Snyk Code, SonarQube, Veracode Static AnalysisTwo alternatives
CodeQL, Snyk CodeSix alternatives
Bandit, Brakeman, Codacy, Qodana, SonarQube, gosecFour alternatives
Checkmarx One, CodeQL, Snyk Code, SonarQubeLlama 4 MaverickSnyk CodeSonarQubeChangedno first choiceSemgrep AppSec Platformno first choicenothing named
One alternative
SonarQubeTwo alternatives
Semgrep AppSec Platform, Snyk CodeTwo alternatives
Codacy, QodanaQwen 3.7 FlashSnyk, SonarQubeSemgrep AppSec Platform, SonarQubeChangedagainst: OpenText FortifyCheckmarx One, Semgrep AppSec Platform, Snyk Code, Veracode Static AnalysisSemgrep AppSec Platformagainst: Checkmarx One, OpenText Fortify, Snyk Code, Veracode Static Analysisno first choiceagainst: Checkmarx One, OpenText Fortifyagainst: Checkmarx One, OpenText Fortify, RIPS, Scan4all, SonarQube
Two alternatives
GitHub Advanced Security, GitLab SASTTwo alternatives
GitHub Advanced Security, Snyk CodeOne alternative
SonarQubeSix alternatives
Bandit, Codacy, ESLint, Qodana, SonarQube, gosecKimi K2Semgrep AppSec Platform, Snyk CodeSnyk Code, SonarQubeChangedagainst: Checkmarx One, Veracode Static AnalysisSemgrep AppSec PlatformSemgrep AppSec Platformno first choiceagainst: Checkmarx One, Veracode Static Analysisagainst: SonarQube
One alternative
SonarQubeOne alternative
Semgrep AppSec PlatformFive alternatives
Checkmarx One, CodeQL, Snyk Code, SonarQube, Veracode Static AnalysisFive alternatives
Bandit, Brakeman, CodeQL, SonarQube, gosecGLM 4.7 FlashXSnyk Codeagainst: Checkmarx One, Veracode Static AnalysisSemgrep AppSec PlatformChangedagainst: Checkmarx OneSemgrep AppSec Platform, Snyk CodeSemgrep AppSec Platformno first choiceagainst: SonarQube
Three alternatives
CodeAnt AI, Semgrep AppSec Platform, SonarQubeTwo alternatives
GitHub Advanced Security, SonarQubeEight alternatives
Black Duck Coverity, Checkmarx One, CodeQL, DeepSource, OpenText Fortify, SonarQube, Veracode Static Analysis, gosecSix alternatives
Codacy, CodeAnt AI, CodeQL, Qodana, Snyk Code, SonarQubeMiniMax M2.5Snyk Code, SonarQubeSonarQubeChangedno first choiceSemgrep AppSec Platformno first choiceagainst: Checkmarx One, OpenText Fortify
Two alternatives
Checkmarx One, Semgrep AppSec PlatformTwo alternatives
CodeQL, Semgrep AppSec PlatformFive alternatives
Checkmarx One, CodeQL, Semgrep AppSec Platform, Snyk Code, Veracode Static AnalysisTwo alternatives
Qodana, SonarQubeBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:38 | no | 0 | 4 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:28 | yes | 5 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:52 | yes | 16 | 23 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-17 11:27 | yes | 20 | 6 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 13:09 | yes | 39 | 19 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:13 | yes | 5 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:58 | yes | 18 | 20 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 09:23 | yes | 5 | 3 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 09:32 | yes | 15 | 50 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 14:13 | yes | 9 | 18 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:29 | yes | 13 | 63 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:49 | yes | 5 | 18 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:01 | no | 0 | 6 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:30 | yes | 2 | 8 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 14:10 | yes | 16 | 23 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-17 14:01 | yes | 20 | 5 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 14:07 | yes | 45 | 20 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:08 | yes | 5 | 7 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 10:00 | yes | 18 | 20 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:45 | yes | 5 | 4 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 13:36 | no | 0 | 37 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:53 | yes | 10 | 29 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:54 | yes | 24 | 116 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:51 | yes | 9 | 24 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:31 | yes | 9 | 8 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:08 | yes | 4 | 9 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:12 | yes | 13 | 26 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-17 14:08 | yes | 20 | 13 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:41 | yes | 27 | 17 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:55 | yes | 5 | 8 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 09:52 | yes | 11 | 30 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:31 | yes | 5 | 3 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:37 | yes | 5 | 32 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:45 | yes | 10 | 26 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:04 | yes | 10 | 38 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:11 | yes | 5 | 22 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:48 | yes | 9 | 7 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:18 | yes | 2 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:26 | yes | 10 | 25 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-17 12:49 | yes | 20 | 5 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:07 | yes | 11 | 6 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:45 | yes | 5 | 6 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:24 | yes | 10 | 12 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:18 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:30 | yes | 5 | 23 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 13:01 | yes | 15 | 22 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:03 | yes | 9 | 82 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:34 | yes | 5 | 15 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 12:11 | no | 0 | 7 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:42 | no | 0 | 11 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:11 | yes | 10 | 23 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-17 13:51 | yes | 20 | 10 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:06 | yes | 17 | 11 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 09:28 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:34 | yes | 13 | 23 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 09:42 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:00 | no | 0 | 38 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 09:34 | yes | 14 | 39 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:55 | yes | 14 | 95 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:49 | yes | 5 | 32 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:31 | no | 0 | 4 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:47 | no | 0 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:19 | yes | 20 | 25 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-17 12:45 | yes | 20 | 7 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:58 | yes | 37 | 16 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:12 | yes | 5 | 6 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 13:20 | yes | 20 | 18 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:53 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 14:07 | yes | 5 | 34 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 09:36 | yes | 14 | 22 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:07 | yes | 13 | 47 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 13:16 | yes | 24 | 51 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Aikido read as Aikido Security
Checkmarx read as Checkmarx One
Checkmarx (Checkmarx One) read as Checkmarx One
Checkmarx (CxSAST) read as Checkmarx One
Checkmarx (now part of Veracode) read as Checkmarx One
GitHub Advanced Security / CodeQL read as GitHub Advanced Security
GitLab read as GitLab SAST
GitLab Ultimate read as GitLab SAST
Semgrep read as Semgrep AppSec Platform
Semgrep (Community Edition) read as Semgrep AppSec Platform
Semgrep (Semgrep Code) read as Semgrep AppSec Platform
Semgrep (open-source edition) read as Semgrep AppSec Platform
Semgrep CE read as Semgrep AppSec Platform
Semgrep Code read as Semgrep AppSec Platform
Semgrep Community Edition read as Semgrep AppSec Platform
Semgrep OSS read as Semgrep AppSec Platform
Semgrep Pro read as Semgrep AppSec Platform
Veracode read as Veracode Static Analysis
Unresolved, counted raw
Contrast Assess
Corridor
IBM AppScan Source
NodeJsScan
PHPStan
Parasoft C/C++test
Scan4all
Discontinued, still offered
No shut-down product was recommended here.