Six of fourteen models named HashiCorp Vault first on the direct prompt; zero named Azure Key Vault. Both were named by all fourteen models and HashiCorp Vault carries 81 labels and Azure Key Vault 58, so the shares are not directly comparable.
Named in eight categories this edition.
Named in six categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the secrets management page.
Across every category in the November 2026 Edition, HashiCorp Vault and Azure Key Vault were named in the same answer 191 times, of the 471 answers naming HashiCorp Vault and the 204 naming Azure Key Vault. In those answers Azure Key Vault took the first choice nine times and HashiCorp Vault seventy-one.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of six in this category shown.
“Often recommended to avoid unless you already have a dedicated platform/security team” Mistral Small · negative prompt · hard negative
“Avoid: HashiCorp Vault Community Edition (licensing changes)” Kimi K2 · budget prompt · hard negative
“HashiCorp Vault (HCP / Enterprise) | Multi-cloud, complex enterprise policies, dynamic secrets, heavy compliance. | Steep learning curve... HCP (managed) recommended.” Gemini 3.5 Flash · scale prompt · first choice
“For most modern deployments, HashiCorp Vault (open-source or Cloud) or a major cloud provider's native solution are the most cautious choices” MiniMax M2.5 · negative prompt · first choice
“Centralized secrets management solutions, such as HashiCorp Vault, AWS Secrets Manager or Azure Key Vault, help regain control” Claude Haiku 4.5 · negative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of five in this category shown.
“sensible for single-cloud deployments, but using each as a separate source of truth can create fragmentation and inconsistent policy across clouds” Perplexity Sonar · negative prompt · soft negative
“reasonable options in their respective environments—but they still need least-privilege access, monitoring, and lifecycle management” GPT-6 Luna · negative prompt · soft negative
“Start with AWS Secrets Manager or Azure Key Vault if you're cloud-native” Claude Haiku 4.5 · paraphrase prompt · first choice
“Azure‑centric stack → Azure Key Vault” GLM 4.7 FlashX · paraphrase prompt · first choice
“such as HashiCorp Vault, AWS Secrets Manager or Azure Key Vault, help regain control by storing secrets in a secure, centralized vault” Claude Haiku 4.5 · negative prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.