Six of fourteen models named HashiCorp Vault first on the direct prompt; zero named AWS Secrets Manager. Both were named by all fourteen models and HashiCorp Vault carries 81 labels and AWS Secrets Manager 69, so the shares are not directly comparable.
Named in eight categories this edition.
Named in five categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the secrets management page.
Across every category in the November 2026 Edition, HashiCorp Vault and AWS Secrets Manager were named in the same answer 233 times, of the 471 answers naming HashiCorp Vault and the 244 naming AWS Secrets Manager. In those answers AWS Secrets Manager took the first choice eleven times and HashiCorp Vault seventy-eight.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of six in this category shown.
“Often recommended to avoid unless you already have a dedicated platform/security team” Mistral Small · negative prompt · hard negative
“Avoid: HashiCorp Vault Community Edition (licensing changes)” Kimi K2 · budget prompt · hard negative
“HashiCorp Vault (HCP / Enterprise) | Multi-cloud, complex enterprise policies, dynamic secrets, heavy compliance. | Steep learning curve... HCP (managed) recommended.” Gemini 3.5 Flash · scale prompt · first choice
“For most modern deployments, HashiCorp Vault (open-source or Cloud) or a major cloud provider's native solution are the most cautious choices” MiniMax M2.5 · negative prompt · first choice
“Centralized secrets management solutions, such as HashiCorp Vault, AWS Secrets Manager or Azure Key Vault, help regain control” Claude Haiku 4.5 · negative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of six in this category shown.
“Not recommended for small teams due to vendor lock-in and complexity.” Mistral Small · negative prompt · hard negative
“AWS Secrets Manager (costs add up)” Kimi K2 · budget prompt · hard negative
“Integrate HashiCorp Vault, AWS Secrets Manager, or Azure Key Vault instead of native Kubernetes secrets.” Muse Glimmer 30B · negative prompt · first choice
“Start with AWS Secrets Manager or Azure Key Vault if you're cloud-native” Claude Haiku 4.5 · paraphrase prompt · first choice
“If you're AWS-heavy, choose AWS Secrets Manager.” GPT-6 Luna · paraphrase prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.