Six of fourteen models named HashiCorp Vault first on the direct prompt; zero named Google Secret Manager. Both were named by all fourteen models and HashiCorp Vault carries 81 labels and Google Secret Manager 43, so the shares are not directly comparable.
Named in eight categories this edition.
Named in four categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the secrets management page.
Across every category in the November 2026 Edition, HashiCorp Vault and Google Secret Manager were named in the same answer 144 times, of the 471 answers naming HashiCorp Vault and the 146 naming Google Secret Manager. In those answers Google Secret Manager took the first choice six times and HashiCorp Vault forty-seven.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of six in this category shown.
“Often recommended to avoid unless you already have a dedicated platform/security team” Mistral Small · negative prompt · hard negative
“Avoid: HashiCorp Vault Community Edition (licensing changes)” Kimi K2 · budget prompt · hard negative
“HashiCorp Vault (HCP / Enterprise) | Multi-cloud, complex enterprise policies, dynamic secrets, heavy compliance. | Steep learning curve... HCP (managed) recommended.” Gemini 3.5 Flash · scale prompt · first choice
“For most modern deployments, HashiCorp Vault (open-source or Cloud) or a major cloud provider's native solution are the most cautious choices” MiniMax M2.5 · negative prompt · first choice
“Centralized secrets management solutions, such as HashiCorp Vault, AWS Secrets Manager or Azure Key Vault, help regain control” Claude Haiku 4.5 · negative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of seven in this category shown.
“sensible for single-cloud deployments, but using each as a separate source of truth can create fragmentation and inconsistent policy across clouds” Perplexity Sonar · negative prompt · soft negative
“reasonable options in their respective environments—but they still need least-privilege access, monitoring, and lifecycle management” GPT-6 Luna · negative prompt · soft negative
“Good if you're mostly single-cloud, but often insufficient alone for multi-cloud, rotation, and developer experience.” Grok 4.20 · scale prompt · soft negative
“Best overall for low budget + simplicity: Google Cloud Secret Manager on GCP” GPT-5.4 mini · budget prompt · first choice
“Google Secret Manager — cheapest cloud-native storage: Particularly inexpensive for GCP users” Perplexity Sonar · budget prompt · alternative
“Best for Google Cloud users who want a simpler managed secrets store with strong IAM control” GPT-5.4 mini · comparative prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.