Secrets management
Asked as “secrets management tool”, and as “secrets vault for applications and infrastructure”, on behalf of a mid-market B2B company. 57 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
33%
Contested · HashiCorp Vault 30%
33Doppler30HashiCorp Vault18Infisical19others
33% of first choices, contested.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the three products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Google Secret Manager is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other eleven models zero times of 44. Lab treatment is defined on the method page; the row is marked, not excluded.
All twenty-eight head-to-head pages: the top eight products, each against each
Doppler vs AWS Secrets ManagerDoppler vs AkeylessDoppler vs 1PasswordDoppler vs Azure Key VaultHashiCorp Vault vs InfisicalHashiCorp Vault vs Bitwarden Secrets ManagerHashiCorp Vault vs AWS Secrets ManagerHashiCorp Vault vs AkeylessHashiCorp Vault vs 1PasswordHashiCorp Vault vs Azure Key VaultInfisical vs Bitwarden Secrets ManagerInfisical vs AWS Secrets ManagerInfisical vs AkeylessInfisical vs 1PasswordInfisical vs Azure Key VaultBitwarden Secrets Manager vs AWS Secrets ManagerBitwarden Secrets Manager vs AkeylessBitwarden Secrets Manager vs 1PasswordBitwarden Secrets Manager vs Azure Key VaultAWS Secrets Manager vs AkeylessAWS Secrets Manager vs 1PasswordAWS Secrets Manager vs Azure Key VaultAkeyless vs 1PasswordAkeyless vs Azure Key Vault1Password vs Azure Key Vault
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08
09
10S11
12Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01Doppler33%
Doppler33%02HashiCorp Vault30%
HashiCorp Vault30%03Infisical18%
Infisical18%04Bitwarden Secrets Manager5%
Bitwarden Secrets Manager5%05AWS Secrets Manager4%
AWS Secrets Manager4%06Akeyless4%
Akeyless4%071Password4%
1Password4%08Azure Key Vault2%
Azure Key Vault2%09OpenBao2%
OpenBao2%10Google Secret Manager0%
Google Secret Manager0%11SOPS0%
12CyberArk Conjur0%
CyberArk Conjur0%What they warned about
One of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.20, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
HashiCorp Vault33%
22 of 66 labels negative · 11 of 12 models · 2 hard negative
“the massive operational overhead required to deploy, patch, and scale a self-hosted Vault cluster make it a poor recommendation for mid-sized companies” Gemini 3.5 Flash, paraphrase prompt
Kubernetes Secrets86%
6 of 7 labels negative · 6 of 12 models · 4 hard negative
“Base64 Encoded Secrets (e.g., Unencrypted Kubernetes Secrets): Why avoid: Base64 is encoding, not encryption.” GLM 4.7 FlashX, negative prompt
AWS Secrets Manager13%
8 of 60 labels negative · 5 of 12 models
“AWS Secrets Manager, Azure Key Vault, and similar tools are fine in the right context, but they can create fragmentation and vendor coupling if you operate across multiple clouds.” Perplexity Sonar, negative prompt
Azure Key Vault14%
6 of 42 labels negative · 5 of 12 models
“AWS Secrets Manager, Azure Key Vault, and similar tools are fine in the right context, but they can create fragmentation and vendor coupling if you operate across multiple clouds.” Perplexity Sonar, negative prompt
What they cite
Twelve of the twelve models returned a source list in this edition: four return the pages they cited and eight the search results they consulted.
Sites the answers cite
62 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 827 links across 192 sites, every framing counted. Ranked by the number of answers carrying the site or page.
vendor site · GitGuardian52 answers · 53 citations · 11 models
vendor site · EnvManager38 answers · 47 citations · 11 models
30 answers · 38 citations · 9 models
vendor site · Safeguard27 answers · 32 citations · 11 models
vendor site · Infisical23 answers · 32 citations · 10 models
vendor site · Doppler21 answers · 25 citations · 10 models
20 answers · 20 citations · 9 models
vendor site · Guideflow17 answers · 17 citations · 9 models
vendor site · Cycode15 answers · 15 citations · 6 models
13 answers · 13 citations · 9 models
13 answers · 13 citations · 7 models
vendor site · Akeyless12 answers · 14 citations · 5 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
51 answers · 11 models
37 answers · 11 models
20 answers · 9 models
18 answers · 8 models
17 answers · 9 models
16 answers · 9 models
15 answers · 9 models
14 answers · 6 models
12 answers · 7 models
12 answers · 7 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best secrets management tool”, “secrets management tool”, “secrets management tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Doppler doppler.com | 33% | 159 | 90,500 | 11,875 | 2,255 | 12 | ||
| HashiCorp Vault hashicorp.com | 30% | 400 | 5,400 | 317 | 173,934 | $26 | 29 | 7 |
| Infisical infisical.com | 18% | 177 | 4,400 | 40 | 4,742 | 14 | 3 | |
| Bitwarden bitwarden.com Bitwarden Secrets Manager 5% | 5% | 36 | 165,000 | 2,160 | 474,514 company | $62 | 52 | |
| AWS parent site AWS Secrets Manager 4%, AWS Systems Manager Parameter Store 0% | 4% | 195 | 368,000 | 114,001 | ||||
| Akeyless akeyless.io | 4% | 138 | 1,000 | 16 | 3,357 | $916 | 24 | 2 |
| 1Password 1password.com | 4% | 274 | 201,000 | 3,085 | 927,263 | 120 | ||
| Azure parent site Azure Key Vault 2% | 2% | 157 | 301,000 | 47,904 | ||||
| OpenBao openbao.org | 2% | 46 | 1,600 | 13 | 1,491 | |||
| Google Secret Manager cloud.google.com | 0% | 115 | 1,000 | 46 | 7,405,347 |
Google's top ten for the three searches hold 20 sites; 4 of them are among the sites the models cited here (akeyless.io, blog.gitguardian.com, cycode.com, infisical.com). The first result for “best secrets management tool” is tigergate.dev.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best secrets management tool for a mid-market B2B company?”Paraphrase“Which secrets vault for applications and infrastructure would you recommend to a mid-sized B2B company?”Comparative“What are the top secrets management tools and how do they differ?”Budget-constrained“What is the best secrets management tool for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a secrets management tool. What should we look at?”Negative“Which secrets management tools should I avoid or be cautious about?”
Claude Haiku 4.5Doppler, Infisicalagainst: HashiCorp VaultDopplerChangedagainst: HashiCorp Vaultno first choiceBitwarden Secrets Manager, HashiCorp Vaultno first choiceagainst: Ansible, Chef, Jenkins, Kubernetes Secrets, Puppet
One alternative
AWS Secrets ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, InfisicalFive alternatives
AWS Secrets Manager, Azure Key Vault, External Secrets Operator, Google Secret Manager, Sealed SecretsGPT-5.4 miniHashiCorp Vaultagainst: 1PasswordHashiCorp VaultHeldHashiCorp VaultHashiCorp Vaultno first choiceagainst: HashiCorp Vault
Two alternatives
AWS Secrets Manager, Azure Key VaultThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerGemini 3.5 FlashDoppler, Infisicalagainst: 1Password, Azure Key Vault, Google Secret Manager, HashiCorp Vault, Keeper Secrets Manager, OpenBaoDopplerChangedagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager, HashiCorp Vaultno first choiceagainst: AWS Secrets ManagerBitwarden Secrets Manager, Infisicalagainst: AWS Secrets Manager, HashiCorp Vault, OpenBaoDoppler, Infisicalagainst: 1Password, HashiCorp Vault, Keeper Secrets Manageragainst: Doppler, HashiCorp Vault, Kubernetes Secrets, git-crypt, git-secret, transcrypt
One alternative
AWS Secrets ManagerTwo alternatives
Akeyless, InfisicalSix alternatives
Akeyless, Doppler, HashiCorp Vault, Infisical, OpenBao, SOPSFour alternatives
AWS Systems Manager Parameter Store, Doppler, EnvManager, SOPSFive alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, Google Secret Manager, OpenBaoPerplexity SonarDopplerHashiCorp VaultChangedagainst: WorkOS Vaultno first choiceInfisicalagainst: AWS Secrets Manager, HashiCorp Vaultno first choiceagainst: AWS Secrets Manager, Azure Key Vault
Three alternatives
AWS Secrets Manager, HashiCorp Vault, InfisicalTwo alternatives
AWS Secrets Manager, DopplerThree alternatives
Doppler, OpenBao, SOPSGrok 4.20Doppleragainst: HashiCorp VaultHashiCorp VaultChangedHashiCorp VaultInfisicalno first choiceagainst: CyberArk Secrets Manageragainst: CyberArk Conjur, Delinea Secret Server, HashiCorp Vault, Kubernetes Secrets
Three alternatives
1Password, AWS Secrets Manager, InfisicalFour alternatives
AWS Secrets Manager, Azure Key Vault, Doppler, InfisicalFive alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret ManagerThree alternatives
AWS Secrets Manager, Doppler, HashiCorp VaultMistral Small1Password, DopplerDopplerChangedHashiCorp VaultBitwarden Secrets Manager, Infisicalagainst: HashiCorp Vaultno first choiceagainst: Doppler, Keeper, Kubernetes Secrets
Two alternatives
AWS Secrets Manager, HashiCorp VaultTwo alternatives
AWS Secrets Manager, HashiCorp VaultSix alternatives
AWS Secrets Manager, Azure Key Vault, Doppler, Google Secret Manager, Infisical, OpenBaoOne alternative
DopplerDeepSeek V4 FlashDoppleragainst: HashiCorp VaultAWS Secrets Manager, Azure Key Vault, HashiCorp VaultChangedHashiCorp VaultInfisicalagainst: HashiCorp VaultHashiCorp Vaultagainst: AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, HashiCorp Vault, Infisical, Kubernetes Secrets
One alternative
AWS Secrets ManagerTwo alternatives
Doppler, InfisicalSix alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, InfisicalFive alternatives
AWS Secrets Manager, Azure Key Vault, Bitwarden Secrets Manager, Google Secret Manager, OpenBaoThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerLlama 4 Maverickno first choiceHashiCorp VaultChangedno first choiceDopplerno first choiceagainst: AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, HashiCorp Vault, Infisical
Three alternatives
AWS Secrets Manager, CyberArk Conjur, EnvManagerTwo alternatives
EnvManager, InfisicalQwen 3.7 FlashDoppleragainst: HashiCorp VaultAWS Secrets ManagerChangedHashiCorp VaultDopplerno first choiceagainst: HashiCorp Vaultagainst: 1Password, Bitwarden Secrets Manager, GitHub Advanced Security scans, Gitleaks, HashiCorp Vault, LastPass, TruffleHog
Two alternatives
EnvManager, InfisicalTwo alternatives
Doppler, HashiCorp VaultSix alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Secrets Manager, Doppler, External Secrets Operator, Sealed SecretsFive alternatives
AWS Secrets Manager, Azure Key Vault, Bitwarden Secrets Manager, Google Secret Manager, HashiCorp VaultThree alternatives
Akeyless, CyberArk Identity, DopplerKimi K21Password, Doppleragainst: HashiCorp VaultDoppler, HashiCorp VaultChangedHashiCorp VaultInfisicalDoppler, HashiCorp Vaultagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager, HashiCorp Vault, LastPass
One alternative
InfisicalThree alternatives
AWS Secrets Manager, Azure Key Vault, InfisicalSix alternatives
1Password, AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, InfisicalThree alternatives
Doppler, HashiCorp Vault, OpenBaoThree alternatives
1Password, AWS Secrets Manager, InfisicalGLM 4.7 FlashXDoppler, HashiCorp Vaultagainst: Akeyless, CyberArk ConjurHashiCorp VaultChangedHashiCorp VaultInfisical, OpenBaoagainst: HashiCorp VaultAkeyless, HashiCorp Vaultagainst: 1Password, Keeperagainst: AWS Systems Manager Parameter Store, GitGuardian, Kubernetes Secrets, SOPS, TruffleHog
Three alternatives
1Password, AWS Secrets Manager, Azure Key VaultThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerFive alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Privileged Access Security, Doppler, Google Secret ManagerFour alternatives
Bitwarden Secrets Manager, Doppler, Google Secret Manager, SOPSFive alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, InfisicalMiniMax M2.5Doppler, HashiCorp VaultHashiCorp VaultChangedHashiCorp VaultAkeyless, DopplerHashiCorp Vaultnothing named
Four alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret Manager, InfisicalTwo alternatives
AWS Secrets Manager, Azure Key VaultSix alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, InfisicalTwo alternatives
HashiCorp Vault, InfisicalThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 14:01 | yes | 9 | 8 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:00 | yes | 3 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:59 | yes | 13 | 21 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-17 10:45 | yes | 20 | 5 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:34 | yes | 45 | 19 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:26 | yes | 9 | 11 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 10:28 | yes | 9 | 14 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:59 | yes | 6 | 5 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 09:35 | yes | 10 | 61 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 13:07 | yes | 17 | 28 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:42 | yes | 29 | 103 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:17 | yes | 5 | 30 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:01 | yes | 17 | 10 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:50 | yes | 4 | 6 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 13:07 | yes | 11 | 23 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-17 10:53 | yes | 20 | 6 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 11:08 | yes | 34 | 16 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:17 | yes | 5 | 6 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:01 | yes | 18 | 19 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:45 | yes | 8 | 4 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 11:11 | no | 0 | 36 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 12:23 | yes | 9 | 29 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:37 | yes | 10 | 26 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 14:01 | yes | 10 | 30 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 12:04 | yes | 0 | 7 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:31 | yes | 5 | 9 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:48 | yes | 11 | 30 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-17 11:33 | yes | 20 | 9 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:08 | yes | 13 | 8 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:11 | yes | 14 | 15 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 13:55 | yes | 9 | 18 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:00 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 09:58 | no | 0 | 44 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:18 | yes | 14 | 42 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:14 | no | 0 | 11 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:06 | yes | 8 | 34 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:07 | no | 0 | 5 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:57 | no | 0 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:09 | yes | 19 | 27 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-17 10:12 | yes | 20 | 5 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 13:56 | yes | 17 | 11 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:21 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 14:10 | yes | 15 | 14 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:10 | yes | 5 | 3 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:46 | no | 0 | 35 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 13:43 | yes | 9 | 21 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 11:07 | yes | 13 | 50 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:36 | yes | 10 | 21 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 12:17 | no | 0 | 7 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:37 | no | 0 | 7 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 14:14 | yes | 10 | 29 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-17 14:09 | yes | 18 | 9 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 13:49 | yes | 17 | 13 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:47 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 13:42 | yes | 10 | 16 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:56 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:42 | yes | 5 | 30 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 10:16 | yes | 14 | 30 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:36 | yes | 13 | 79 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 13:10 | yes | 5 | 28 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:04 | yes | 18 | 9 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:25 | yes | 4 | 25 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:30 | yes | 24 | 26 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-17 14:04 | yes | 20 | 6 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:09 | yes | 34 | 15 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 12:32 | yes | 5 | 8 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 09:31 | yes | 20 | 17 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:36 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 09:58 | yes | 15 | 73 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 14:02 | yes | 27 | 54 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:20 | yes | 20 | 59 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:31 | yes | 5 | 13 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Bitwarden read as Bitwarden Secrets Manager
Bitwarden (Business Plan) read as Bitwarden Secrets Manager
CyberArk read as CyberArk Secrets Manager
Delinea read as Delinea Secret Server
Unresolved, counted raw
CyberArk Privileged Access Security (PAS)
GitHub Advanced Security scans
WorkOS Vault
transcrypt
Discontinued, still offered
No shut-down product was recommended here.