Secrets management for enterprise buyers
Asked as “secrets management tool”, and as “secrets vault for applications and infrastructure”, on behalf of an enterprise B2B company. 40 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
75%
HashiCorp VaultClear leader
75HashiCorp Vault10Akeyless051Password10others
75% of first choices, clear leader.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the three products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Google Secret Manager is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other eleven models zero times of 44. Lab treatment is defined on the method page; the row is marked, not excluded.
Head to headHead-to-head pages are published for mid-market buyers, so these open on mid-market figures, not enterprise.
All twenty-eight head-to-head pages: the top eight products, each against each
Doppler vs AWS Secrets ManagerDoppler vs AkeylessDoppler vs 1PasswordDoppler vs Azure Key VaultHashiCorp Vault vs InfisicalHashiCorp Vault vs Bitwarden Secrets ManagerHashiCorp Vault vs AWS Secrets ManagerHashiCorp Vault vs AkeylessHashiCorp Vault vs 1PasswordHashiCorp Vault vs Azure Key VaultInfisical vs Bitwarden Secrets ManagerInfisical vs AWS Secrets ManagerInfisical vs AkeylessInfisical vs 1PasswordInfisical vs Azure Key VaultBitwarden Secrets Manager vs AWS Secrets ManagerBitwarden Secrets Manager vs AkeylessBitwarden Secrets Manager vs 1PasswordBitwarden Secrets Manager vs Azure Key VaultAWS Secrets Manager vs AkeylessAWS Secrets Manager vs 1PasswordAWS Secrets Manager vs Azure Key VaultAkeyless vs 1PasswordAkeyless vs Azure Key Vault1Password vs Azure Key Vault
One product takes 75% of first choices here, so the chart would put eight markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Five products carry a negative rate above 25% in this category.
What they warned about
Eleven of twelve models held their first choice under the paraphrase. Claude Haiku 4.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
AWS Secrets Manager31%
16 of 52 labels negative · 10 of 12 models · 1 hard negative
“Avoid AWS Secrets Manager for your use case \u2014 the per-secret pricing ($0.40/month) becomes prohibitively expensive” Kimi K2, budget prompt
Azure Key Vault31%
15 of 49 labels negative · 10 of 12 models
“Azure Key Vault also has operation-based pricing. That makes cost scale with workload and user activity, which is less predictable at large scale.” GPT-5.4 mini, budget prompt
Google Secret Manager39%
14 of 36 labels negative · 10 of 12 models
“such as AWS Secrets Manager, Azure Key Vault, and GCP Secret Manager as the *primary* store in a multi-cloud or hybrid enterprise” Perplexity Sonar, negative prompt
Doppler27%
11 of 41 labels negative · 8 of 12 models · 1 hard negative
“Tools like Doppler ($21/user/month) ... become extremely costly at scale” MiniMax M2.5, budget prompt
What they cite
Twelve of the twelve models returned a source list in this edition: four return the pages they cited and eight the search results they consulted.
Sites the answers cite
64 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 950 links across 225 sites, every framing counted. Ranked by the number of answers carrying the site or page.
vendor site · GitGuardian49 answers · 53 citations · 11 models
vendor site · EnvManager37 answers · 47 citations · 11 models
vendor site · Akeyless31 answers · 54 citations · 9 models
vendor site · Cycode31 answers · 33 citations · 10 models
30 answers · 37 citations · 9 models
vendor site · Doppler26 answers · 45 citations · 9 models
vendor site · Safeguard26 answers · 29 citations · 9 models
vendor site · Guideflow25 answers · 26 citations · 10 models
vendor site · Infisical23 answers · 38 citations · 9 models
vendor site · HashiCorp17 answers · 24 citations · 9 models
14 answers · 17 citations · 7 models
vendor site · OWASP13 answers · 14 citations · 10 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
48 answers · 11 models
35 answers · 11 models
30 answers · 10 models
25 answers · 10 models
22 answers · 8 models
18 answers · 7 models
13 answers · 7 models
13 answers · 10 models
13 answers · 8 models
12 answers · 8 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best secrets management tool”, “secrets management tool”, “secrets management tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| HashiCorp Vault hashicorp.com | 75% | 400 | 5,400 | 317 | 173,934 | $26 | 29 | 7 |
| Akeyless akeyless.io | 10% | 138 | 1,000 | 16 | 3,357 | $916 | 24 | 2 |
| Doppler doppler.com | 5% | 159 | 90,500 | 11,875 | 2,255 | 12 | ||
| 1Password 1password.com | 5% | 274 | 201,000 | 3,085 | 927,263 | 120 | ||
| AWS parent site AWS Secrets Manager 2% | 2% | 195 | 368,000 | 114,001 | ||||
| Infisical infisical.com | 2% | 177 | 4,400 | 40 | 4,742 | 14 | 3 | |
| CyberArk cyberark.com CyberArk Conjur 0%, CyberArk Secrets Manager 0% | 0% | 72 | 22,200 | 1,253 | 147,793 company | $62 | 0 | |
| Azure parent site Azure Key Vault 0% | 0% | 157 | 301,000 | 47,904 | ||||
| Google Secret Manager cloud.google.com | 0% | 115 | 1,000 | 46 | 7,405,347 | |||
| OpenBao openbao.org | 0% | 46 | 1,600 | 13 | 1,491 |
Google's top ten for the three searches hold 20 sites; 5 of them are among the sites the models cited here (akeyless.io, blog.gitguardian.com, cycode.com, hashicorp.com, infisical.com). The first result for “best secrets management tool” is tigergate.dev.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best secrets management tool for an enterprise B2B company?”Paraphrase“Which secrets vault for applications and infrastructure would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade secrets management tools and how do they differ?”Budget-constrained“What is the best secrets management tool for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a secrets management tool. What should we look at?”Negative“Which secrets management tools should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5Akeyless, HashiCorp VaultHashiCorp VaultChangedHashiCorp VaultAWS Secrets Managerno first choicenothing named
One alternative
CyberArk ConjurTwo alternatives
AWS Secrets Manager, Azure Key VaultSix alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, InfisicalTwo alternatives
Google Secret Manager, InfisicalGPT-5.4 miniHashiCorp VaultHashiCorp VaultHeldHashiCorp VaultHashiCorp Vaultagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Managerno first choicenothing named
Two alternatives
AWS Secrets Manager, CyberArk ConjurThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerFour alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Google Secret ManagerGemini 3.5 FlashAkeylessagainst: HashiCorp VaultAkeylessHeldagainst: CyberArk ConjurHashiCorp VaultAkeylessagainst: AWS Secrets Manager, Azure Key Vault, Doppler, Google Secret Manager, HashiCorp Vaultno first choiceagainst: 1Password, AWS Secrets Manager, Ansible Vault, Azure Key Vault, Bitwarden Secrets Manager, Dashlane, Google Secret Manager, HashiCorp Vault, Infisical, LastPass, OpenBao, SOPS, blackbox, git-crypt, git-secret
Three alternatives
AWS Secrets Manager, Infisical, OpenBaoTwo alternatives
HashiCorp Vault, InfisicalEight alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, Infisical, OpenBaoOne alternative
InfisicalPerplexity SonarHashiCorp VaultHashiCorp VaultHeldHashiCorp VaultDoppleragainst: AWS Secrets Manager, Azure Key Vault, Google Secret Managerno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager, Kubernetes Secrets
Six alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Secrets Manager, Doppler, InfisicalSeven alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, InfisicalSeven alternatives
1Password, AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret ManagerOne alternative
HashiCorp VaultGrok 4.20HashiCorp Vaultagainst: AkeylessHashiCorp VaultHeldHashiCorp Vaultagainst: Doppler, Infisical1Passwordagainst: AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, InfisicalHashiCorp Vaultagainst: 1Password, AWS Secrets Manager, Azure Key Vault, Doppler, Google Secret Manager, HashiCorp Vault, Infisical
Four alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Delinea Secret ServerThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerFive alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Google Secret ManagerOne alternative
HashiCorp VaultTwo alternatives
1Password, DopplerMistral SmallHashiCorp VaultHashiCorp VaultHeldHashiCorp VaultHashiCorp Vaultagainst: 1Password, AWS Secrets Manager, Azure Key Vault, Doppler, Google Secret Managerno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager
Four alternatives
1Password, AWS Secrets Manager, Azure Key Vault, Google Secret ManagerTwo alternatives
1Password, DopplerFour alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk ConjurDeepSeek V4 FlashHashiCorp VaultHashiCorp VaultHeldagainst: AWS Secrets Manager, Azure Key VaultHashiCorp VaultHashiCorp Vaultagainst: 1Password, AWS Secrets Manager, Akeyless, Azure Key Vault, Doppler, Google Secret Manager, HashiCorp Vault, InfisicalHashiCorp Vaultagainst: AWS/Azure/GCP native managersagainst: 1Password, Bitwarden Secrets Manager, CyberArk Secrets Manager, Delinea Secret Server, HashiCorp Vault, LastPass
Four alternatives
AWS Secrets Manager, CyberArk Conjur, Doppler, InfisicalTwo alternatives
Akeyless, CyberArk ConjurSeven alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Secrets Manager, Doppler, Google Secret Manager, InfisicalOne alternative
EnvManagerFour alternatives
1Password, Akeyless, CyberArk Conjur, DopplerLlama 4 MaverickHashiCorp VaultHashiCorp VaultHeldno first choiceHashiCorp Vaultno first choiceagainst: CyberArk Conjur, Doppler, HashiCorp Vault
One alternative
GitGuardianTwo alternatives
Doppler, InfisicalQwen 3.7 FlashHashiCorp VaultHashiCorp VaultHeldagainst: DopplerHashiCorp Vault1Passwordagainst: HashiCorp Vault, Latticeno first choiceagainst: 1Password, AWS Secrets Manager, Azure Key Vault, Boomi, CyberArk Conjur, CyberArk Secrets Manager, Dashlane, Delinea Secret Server, Google Secret Manager, HashiCorp Vault, LastPass, NordPass, git-crypt, kube-secrets-operator
Two alternatives
Akeyless, DopplerThree alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Secrets ManagerFive alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Secrets Manager, Delinea Secret ServerTwo alternatives
Bitwarden Secrets Manager, KeeperTwo alternatives
CyberArk Conjur, HashiCorp VaultKimi K2HashiCorp VaultHashiCorp VaultHeldHashiCorp VaultDoppler, HashiCorp Vaultagainst: AWS Secrets Manager, Akeyless, CyberArk Conjurno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manageragainst: Doppler, HashiCorp Vault, LastPass, SOPS
Three alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk ConjurThree alternatives
1Password, Akeyless, CyberArk ConjurFive alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Google Secret ManagerOne alternative
Azure Key VaultFour alternatives
1Password, CyberArk Conjur, Doppler, HashiCorp VaultGLM 4.7 FlashXHashiCorp VaultHashiCorp VaultHeldHashiCorp Vaultno first choiceno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager, HashiCorp Vault, Infisical, Kubernetes Secrets
Five alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, InfisicalThree alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk ConjurFive alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Google Secret ManagerMiniMax M2.5HashiCorp VaultHashiCorp VaultHeldHashiCorp VaultHashiCorp Vault, Infisicalagainst: 1Password, Doppler, Keeperno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Doppler, EnvManager, Google Secret Manager, Infisical
Four alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, Google Secret ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk ConjurFour alternatives
AWS Secrets Manager, Akeyless, Doppler, InfisicalThree alternatives
CyberArk Secrets Manager, Delinea Secret Server, EnvManagerBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 12:21 | yes | 9 | 9 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:38 | yes | 4 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:52 | yes | 13 | 24 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-17 11:59 | yes | 20 | 4 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 11:45 | yes | 35 | 15 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:52 | yes | 20 | 27 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:28 | yes | 8 | 13 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:40 | yes | 5 | 3 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 13:22 | yes | 5 | 32 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 10:10 | yes | 9 | 33 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:41 | yes | 15 | 53 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:56 | yes | 5 | 15 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 09:48 | no | 0 | 7 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:08 | yes | 4 | 8 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:50 | yes | 18 | 32 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-17 10:47 | yes | 20 | 6 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:50 | yes | 23 | 11 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 14:11 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:14 | yes | 18 | 22 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 09:32 | yes | 5 | 3 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:03 | yes | 5 | 45 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 09:39 | yes | 10 | 20 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:20 | yes | 29 | 47 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:14 | yes | 5 | 33 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:40 | yes | 9 | 10 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 09:25 | yes | 7 | 11 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 13:08 | yes | 14 | 36 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-17 10:38 | yes | 20 | 10 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 09:37 | yes | 24 | 13 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:11 | yes | 10 | 9 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-09-17 13:27 | yes | 20 | 47 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:45 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 13:26 | no | 0 | 40 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 10:35 | yes | 10 | 32 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:38 | yes | 9 | 58 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 09:56 | yes | 8 | 23 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:08 | yes | 16 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:07 | yes | 3 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 09:36 | yes | 20 | 32 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-17 09:52 | yes | 20 | 6 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:26 | yes | 44 | 17 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:41 | yes | 5 | 5 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:10 | yes | 26 | 31 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 09:59 | yes | 5 | 3 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 09:59 | no | 0 | 44 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 09:56 | yes | 28 | 40 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 11:57 | yes | 22 | 248 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:34 | yes | 17 | 80 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:14 | yes | 19 | 14 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:34 | no | 0 | 11 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 09:56 | no | 0 | 17 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-17 12:51 | yes | 20 | 8 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 11:05 | yes | 13 | 14 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:20 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:08 | yes | 20 | 28 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:18 | yes | 5 | 4 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 11:39 | no | 0 | 36 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 13:44 | yes | 10 | 58 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:17 | yes | 26 | 101 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:59 | yes | 19 | 40 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:14 | yes | 16 | 8 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:06 | yes | 3 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 14:12 | yes | 23 | 39 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-17 13:17 | yes | 20 | 5 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:08 | yes | 20 | 13 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 11:03 | yes | 5 | 7 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 09:35 | yes | 25 | 28 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 12:03 | yes | 5 | 4 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:36 | no | 0 | 38 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 10:24 | yes | 20 | 55 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:28 | yes | 28 | 64 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:44 | yes | 21 | 77 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Bitwarden read as Bitwarden Secrets Manager
Bitwarden (Business) read as Bitwarden Secrets Manager
Bitwarden Enterprise read as Bitwarden Secrets Manager
CyberArk read as CyberArk Secrets Manager
CyberArk (Conjur / Secrets Manager) read as CyberArk Secrets Manager
CyberArk (Privileged Identity Manager & Conjur) read as CyberArk Secrets Manager
CyberArk (when used alone for secrets) read as CyberArk Secrets Manager
Delinea read as Delinea Secret Server
Delinea (Centrify) read as Delinea Secret Server
Delinea (formerly Thycotic) read as Delinea Secret Server
Thycotic read as Delinea Secret Server
Unresolved, counted raw
CyberArk Vault
Genuit
HashiCorp Consul Connect
kube-secrets-operator
Discontinued, still offered
No shut-down product was recommended here.