Zero of fourteen models named Huntress Managed EDR first on the direct prompt; one named CrowdStrike Charlotte AI. Huntress Managed EDR was named by nine of the fourteen models and CrowdStrike Charlotte AI by fourteen and Huntress Managed EDR carries 11 labels and CrowdStrike Charlotte AI 28, so the shares are not directly comparable.
Named in seven categories this edition.
Named in two categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the AI SOC agents page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. One of one in this category shown.
“the most cost-predictable commercial agentic option in the current evaluations is UnderDefense Agentic AI SOC or Huntress” Muse Glimmer 30B · budget prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Avoid or deprioritize high-end ones like ... CrowdStrike Charlotte AI” Grok 4.20 · budget prompt · hard negative
“products like CrowdStrike Charlotte AI were showing 0% first-choice share in that edition with limited labels” Muse Glimmer 30B · negative prompt · soft negative
“generally less specialized/autonomous than the pure-play startups above for a standalone mid-sized setup” Grok 4.20 · paraphrase prompt · soft negative
“I'd lean CrowdStrike Charlotte AI if you already use CrowdStrike for endpoint/identity/cloud security” GPT-5.4 mini · direct prompt · first choice
“If your endpoint protection is dominated by Falcon, Charlotte AI provides deep visibility and automated response capabilities” Qwen 3.7 Flash · direct prompt · alternative
“| 4 | CrowdStrike Charlotte AI | 0% but strong presence | Trained on elite analyst judgment, ecosystem-native |” MiniMax M2.5 · comparative prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.