Secrets management for small business buyers
Asked as “secrets management tool”, and as “secrets vault for applications and infrastructure”, on behalf of a small B2B company. 56 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
46%
Clear leader
46Doppler25Infisical091Password20others
46% of first choices, clear leader.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a small B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the three products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Google Secret Manager is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other eleven models zero times of 44. Lab treatment is defined on the method page; the row is marked, not excluded.
Head to headHead-to-head pages are published for mid-market buyers, so these open on mid-market figures, not small business.
All twenty-eight head-to-head pages: the top eight products, each against each
Doppler vs AWS Secrets ManagerDoppler vs AkeylessDoppler vs 1PasswordDoppler vs Azure Key VaultHashiCorp Vault vs InfisicalHashiCorp Vault vs Bitwarden Secrets ManagerHashiCorp Vault vs AWS Secrets ManagerHashiCorp Vault vs AkeylessHashiCorp Vault vs 1PasswordHashiCorp Vault vs Azure Key VaultInfisical vs Bitwarden Secrets ManagerInfisical vs AWS Secrets ManagerInfisical vs AkeylessInfisical vs 1PasswordInfisical vs Azure Key VaultBitwarden Secrets Manager vs AWS Secrets ManagerBitwarden Secrets Manager vs AkeylessBitwarden Secrets Manager vs 1PasswordBitwarden Secrets Manager vs Azure Key VaultAWS Secrets Manager vs AkeylessAWS Secrets Manager vs 1PasswordAWS Secrets Manager vs Azure Key VaultAkeyless vs 1PasswordAkeyless vs Azure Key Vault1Password vs Azure Key Vault
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08
09
10Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative60%
Key
01Doppler46%
Doppler46%02Infisical25%
Infisical25%031Password9%
1Password9%04Bitwarden Secrets Manager7%
Bitwarden Secrets Manager7%05HashiCorp Vault5%
HashiCorp Vault5%06AWS Secrets Manager4%
AWS Secrets Manager4%07Azure Key Vault2%
Azure Key Vault2%08Google Secret Manager0%
Google Secret Manager0%09Akeyless0%
Akeyless0%10OpenBao0%
OpenBao0%What they warned about
Three of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Kimi K2 and GLM 4.7 FlashX changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
HashiCorp Vault70%
46 of 66 labels negative · 12 of 12 models · 18 hard negative
“that often means HashiCorp Vault unless you already have a platform/security team ... makes it a poor fit for many small businesses without dedicated ops support” Perplexity Sonar, negative prompt
AWS Secrets Manager25%
13 of 52 labels negative · 8 of 12 models · 3 hard negative
“Tools to Avoid for Small B2B ... limited multi-cloud support and can get expensive with per-secret pricing.” Kimi K2, direct prompt
Google Secret Manager29%
8 of 28 labels negative · 6 of 12 models
“avoid cloud-provider-native tools like AWS Secrets Manager, GCP Secret Manager, and Azure Key Vault as your primary secrets store” Claude Haiku 4.5, negative prompt
Azure Key Vault21%
6 of 29 labels negative · 5 of 12 models
“sometimes cloud-native managers like ... Azure Key Vault ... if you are not primarily on that cloud” Perplexity Sonar, negative prompt
What they cite
Twelve of the twelve models returned a source list in this edition: four return the pages they cited and eight the search results they consulted.
Sites the answers cite
60 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 777 links across 177 sites, every framing counted. Ranked by the number of answers carrying the site or page.
34 answers · 42 citations · 10 models
vendor site · EnvManager34 answers · 38 citations · 11 models
vendor site · GitGuardian33 answers · 33 citations · 11 models
vendor site · Infisical30 answers · 33 citations · 12 models
vendor site · Doppler22 answers · 34 citations · 10 models
20 answers · 24 citations · 8 models
20 answers · 20 citations · 8 models
vendor site · Safeguard19 answers · 24 citations · 10 models
vendor site · Cycode18 answers · 19 citations · 8 models
16 answers · 16 citations · 8 models
vendor site · G215 answers · 21 citations · 9 models
vendor site · Akeyless15 answers · 18 citations · 7 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
33 answers · 11 models
32 answers · 11 models
27 answers · 9 models
20 answers · 8 models
19 answers · 12 models
18 answers · 8 models
18 answers · 8 models
16 answers · 8 models
13 answers · 10 models
13 answers · 7 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best secrets management tool”, “secrets management tool”, “secrets management tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Doppler doppler.com | 46% | 159 | 90,500 | 11,875 | 2,255 | 12 | ||
| Infisical infisical.com | 25% | 177 | 4,400 | 40 | 4,742 | 14 | 3 | |
| 1Password 1password.com | 9% | 274 | 201,000 | 3,085 | 927,263 | 120 | ||
| Bitwarden bitwarden.com Bitwarden Secrets Manager 7% | 7% | 36 | 165,000 | 2,160 | 474,514 company | $62 | 52 | |
| HashiCorp Vault hashicorp.com | 5% | 400 | 5,400 | 317 | 173,934 | $26 | 29 | 7 |
| AWS parent site AWS Secrets Manager 4%, AWS Systems Manager Parameter Store 2% | 5% | 195 | 368,000 | 114,001 | ||||
| Azure parent site Azure Key Vault 2% | 2% | 157 | 301,000 | 47,904 | ||||
| Google Secret Manager cloud.google.com | 0% | 115 | 1,000 | 46 | 7,405,347 | |||
| Akeyless akeyless.io | 0% | 138 | 1,000 | 16 | 3,357 | $916 | 24 | 2 |
| SOPS | 0% | 74,000 | 8,602 |
Google's top ten for the three searches hold 20 sites; 4 of them are among the sites the models cited here (akeyless.io, blog.gitguardian.com, cycode.com, infisical.com). The first result for “best secrets management tool” is tigergate.dev.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best secrets management tool for a small B2B company?”Paraphrase“Which secrets vault for applications and infrastructure would you recommend to a small business that sells to other businesses?”Comparative“What are the top secrets management tools for a small team and how do they differ?”Budget-constrained“What is the best secrets management tool for a small company with a tight budget?”Scale-constrained“We are a 30 person company evaluating a secrets management tool. What should we look at?”Negative“Which secrets management tools should a small business avoid or be cautious about?”
Claude Haiku 4.5no first choiceAWS Secrets Manager, Azure Key VaultChangedDoppleragainst: 1PasswordBitwarden Secrets Managerno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager, HashiCorp Vault
One alternative
HashiCorp VaultFive alternatives
AWS Secrets Manager, Azure Key Vault, Bitwarden Secrets Manager, Google Secret Manager, InfisicalThree alternatives
1Password, OpenBao, SOPSGPT-5.4 mini1Password, Doppleragainst: HashiCorp VaultAWS Secrets Manager, HashiCorp VaultChanged1Password, Doppleragainst: HashiCorp VaultInfisicalagainst: HashiCorp Vaultno first choicenothing named
Three alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerFive alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret Manager, OpenBao, SOPSGemini 3.5 FlashDoppleragainst: HashiCorp Vault, OpenBaoDoppler, InfisicalChangedagainst: HashiCorp VaultDoppleragainst: HashiCorp VaultAWS Systems Manager Parameter Store, Bitwarden Secrets Manageragainst: AWS Secrets Manager, Doppler, HashiCorp Vault, OpenBaoDoppler, Infisicalagainst: AWS Secrets Manager, Google Secret Manager, HashiCorp Vaultagainst: AWS Secrets Manager, CyberArk Secrets Manager, Delinea Secret Server, Google Secret Manager, HashiCorp Vault, Kubernetes Secrets, OpenBao, SOPS, git-crypt
Four alternatives
1Password, AWS Secrets Manager, Google Secret Manager, InfisicalFive alternatives
1Password, AWS Secrets Manager, Azure Key Vault, Bitwarden Secrets Manager, Google Secret ManagerFive alternatives
1Password, AWS Secrets Manager, Bitwarden Secrets Manager, Google Secret Manager, InfisicalTwo alternatives
Infisical, SOPSTwo alternatives
1Password, Bitwarden Secrets ManagerPerplexity Sonar1Password, Infisicalagainst: HashiCorp Vault1Password, DopplerChangedagainst: HashiCorp VaultDoppleragainst: HashiCorp VaultBitwarden Secrets Manager, Infisicalagainst: Cloud-native managers, HashiCorp Vaultno first choiceagainst: AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Google Secret Manager, HashiCorp Vault
Three alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerOne alternative
AWS Secrets ManagerFour alternatives
1Password, AWS Secrets Manager, Bitwarden Secrets Manager, InfisicalThree alternatives
1Password, Doppler, OpenBaoGrok 4.20Doppleragainst: AWS Secrets Manager, HashiCorp VaultDopplerHeldagainst: Azure Key Vault, Google Secret Manager, HashiCorp VaultDoppler, Infisicalagainst: HashiCorp VaultInfisicalagainst: HashiCorp VaultDoppler, Infisicalagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager, HashiCorp Vault, Infisical, Kubernetes Secrets, Sealed Secrets
One alternative
InfisicalThree alternatives
1Password, AWS Secrets Manager, InfisicalTwo alternatives
1Password, Bitwarden Secrets ManagerFour alternatives
Akeyless, Bitwarden Secrets Manager, Cloud-Native, DopplerTwo alternatives
AWS Secrets Manager, HashiCorp VaultMistral Small1Password, Doppleragainst: HashiCorp VaultDopplerChangedDoppleragainst: HashiCorp VaultInfisicalno first choiceagainst: HashiCorp Vault, Infisical
One alternative
Bitwarden Secrets ManagerOne alternative
HashiCorp VaultTwo alternatives
1Password, InfisicalThree alternatives
Doppler, Google Secret Manager, HashiCorp VaultDeepSeek V4 FlashDoppler, Infisicalagainst: HashiCorp VaultDopplerChangedagainst: HashiCorp VaultDoppler, Infisicalagainst: HashiCorp VaultDoppler, Infisicalagainst: HashiCorp VaultDoppler, Infisicalagainst: HashiCorp Vaultagainst: AWS Secrets Manager, HashiCorp Vault, KeePass, LastPass
Two alternatives
AWS Secrets Manager, Bitwarden Secrets ManagerTwo alternatives
AWS Secrets Manager, InfisicalTwo alternatives
AWS Secrets Manager, Google Secret ManagerFour alternatives
Akeyless, Bitwarden Secrets Manager, OpenBao, SOPSTwo alternatives
AWS Secrets Manager, Google Secret ManagerLlama 4 MaverickDoppler, InfisicalHashiCorp VaultChangedDopplerno first choiceno first choiceagainst: HashiCorp Vault
One alternative
HashiCorp VaultQwen 3.7 FlashDoppleragainst: HashiCorp VaultDopplerHeldagainst: HashiCorp VaultDoppleragainst: CyberArk Secrets Manager, HashiCorp VaultDopplerDoppleragainst: HashiCorp Vaultagainst: AWS Secrets Manager, Broadcom Privileged Identity Management, CyberArk Secrets Manager, Dashlane, Delinea Secret Server, HashiCorp Vault, IBM ACF2, LastPass, SOPS
Two alternatives
AWS Secrets Manager, InfisicalThree alternatives
AWS Secrets Manager, Akeyless, Azure Key VaultFour alternatives
1Password, AWS Secrets Manager, Azure Key Vault, Bitwarden Secrets ManagerThree alternatives
AWS Secrets Manager, Bitwarden Secrets Manager, InfisicalFour alternatives
1Password, AWS Secrets Manager, Bitwarden Secrets Manager, Google Secret ManagerKimi K21Passwordagainst: AWS Secrets Manager, HashiCorp VaultDopplerChangedagainst: Azure, CyberArk Conjur, HashiCorp VaultDoppler, InfisicalInfisicalagainst: AWS Secrets Manager, Doppler, HashiCorp VaultDoppleragainst: HashiCorp Vaultagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager, HashiCorp Vault
Three alternatives
Bitwarden Secrets Manager, Doppler, InfisicalTwo alternatives
AWS Secrets Manager, InfisicalThree alternatives
1Password, Bitwarden Secrets Manager, Cloud-Native OptionsThree alternatives
Bitwarden Secrets Manager, OpenBao, SOPSTwo alternatives
1Password, InfisicalGLM 4.7 FlashXDoppleragainst: CyberArk ConjurBitwarden Secrets ManagerChangedDoppler, Infisicalagainst: HashiCorp VaultDoppler, HashiCorp Vaultno first choiceagainst: HashiCorp Vault
Four alternatives
1Password, AWS Secrets Manager, HashiCorp Vault, InfisicalTwo alternatives
AWS Secrets Manager, InfisicalThree alternatives
AWS Secrets Manager, Azure Key Vault, InfisicalMiniMax M2.5DopplerDopplerHeldagainst: HashiCorp VaultDopplerDoppler, Infisicalno first choiceagainst: AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Delinea Secret Server, Google Secret Manager, HashiCorp Vault
Two alternatives
HashiCorp Vault, InfisicalThree alternatives
AWS Secrets Manager, Azure Key Vault, InfisicalFour alternatives
AWS Secrets Manager, Bitwarden Secrets Manager, HashiCorp Vault, InfisicalOne alternative
HashiCorp VaultBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 14:05 | no | 0 | 4 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:18 | no | 0 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:15 | yes | 13 | 21 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-17 10:37 | yes | 20 | 8 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:56 | yes | 18 | 10 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 12:30 | yes | 10 | 10 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:33 | yes | 8 | 12 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:33 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:35 | yes | 5 | 22 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 12:00 | yes | 25 | 35 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:28 | yes | 23 | 87 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:33 | yes | 10 | 33 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:16 | no | 0 | 5 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:15 | yes | 3 | 6 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 13:02 | yes | 12 | 22 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-17 14:07 | yes | 20 | 5 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:15 | yes | 42 | 16 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 09:22 | yes | 5 | 5 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 09:28 | yes | 18 | 17 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:05 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 14:07 | yes | 5 | 35 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 09:31 | yes | 9 | 20 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:16 | yes | 29 | 53 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:05 | yes | 15 | 37 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:13 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:59 | yes | 7 | 11 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:17 | yes | 10 | 20 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-17 12:38 | yes | 20 | 8 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 09:54 | yes | 28 | 13 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 14:05 | yes | 5 | 6 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:21 | yes | 17 | 19 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:22 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 13:20 | no | 0 | 37 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:54 | yes | 10 | 37 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:06 | yes | 9 | 20 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:34 | yes | 10 | 35 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 12:20 | yes | 9 | 7 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 14:06 | yes | 3 | 7 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:26 | yes | 21 | 21 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-17 12:29 | yes | 20 | 6 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 09:26 | yes | 16 | 11 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:35 | yes | 5 | 6 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:24 | yes | 10 | 14 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:55 | yes | 5 | 3 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:59 | yes | 5 | 25 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:21 | yes | 9 | 33 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 11:50 | no | 0 | 82 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 13:36 | yes | 10 | 25 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:42 | no | 0 | 5 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:32 | no | 0 | 6 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 13:41 | yes | 12 | 24 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-17 10:57 | yes | 20 | 7 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:57 | yes | 14 | 10 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:35 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-09-17 13:49 | yes | 10 | 37 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:05 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 13:01 | no | 0 | 38 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:22 | yes | 10 | 24 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:07 | yes | 15 | 176 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:20 | no | 0 | 12 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:29 | yes | 15 | 8 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:19 | no | 0 | 5 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:34 | yes | 9 | 24 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-17 09:30 | yes | 20 | 7 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 13:02 | yes | 21 | 12 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 12:01 | yes | 5 | 6 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:45 | yes | 20 | 20 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:49 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:10 | yes | 5 | 23 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 12:14 | yes | 29 | 59 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 09:23 | no | 0 | 15 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:40 | yes | 19 | 66 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Bitwarden read as Bitwarden Secrets Manager
Bitwarden (Business) read as Bitwarden Secrets Manager
CyberArk read as CyberArk Secrets Manager
Thycotic read as Delinea Secret Server
Unresolved, counted raw
Broadcom Privileged Identity Management
Cloud-Native Options (AWS/GCP/Azure Secrets Managers)
Cloud-native managers
IBM ACF2
Infisec
Discontinued, still offered
No shut-down product was recommended here.