One of fourteen models named CrowdStrike Charlotte AI first on the direct prompt; zero named Microsoft Security Copilot. CrowdStrike Charlotte AI was named by fourteen of the fourteen models and Microsoft Security Copilot by twelve and CrowdStrike Charlotte AI carries 28 labels and Microsoft Security Copilot 30, so the shares are not directly comparable.
Named in two categories this edition.
Named in two categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the AI SOC agents page.
Across every category in the November 2026 Edition, CrowdStrike Charlotte AI and Microsoft Security Copilot were named in the same answer sixty-five times, of the 90 answers naming CrowdStrike Charlotte AI and the 112 naming Microsoft Security Copilot. In those answers Microsoft Security Copilot took the first choice three times and CrowdStrike Charlotte AI four.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | MS | |||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | MS | MS | MS | |||
| Grok 4.20 | ||||||
| Mistral Small | MS | |||||
| DeepSeek V4 Flash | MS | MS | ||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | MS | |||||
| Kimi K2 | MS | MS | ||||
| GLM 4.7 FlashX | MS | |||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Avoid or deprioritize high-end ones like ... CrowdStrike Charlotte AI” Grok 4.20 · budget prompt · hard negative
“products like CrowdStrike Charlotte AI were showing 0% first-choice share in that edition with limited labels” Muse Glimmer 30B · negative prompt · soft negative
“generally less specialized/autonomous than the pure-play startups above for a standalone mid-sized setup” Grok 4.20 · paraphrase prompt · soft negative
“I'd lean CrowdStrike Charlotte AI if you already use CrowdStrike for endpoint/identity/cloud security” GPT-5.4 mini · direct prompt · first choice
“If your endpoint protection is dominated by Falcon, Charlotte AI provides deep visibility and automated response capabilities” Qwen 3.7 Flash · direct prompt · alternative
“| 4 | CrowdStrike Charlotte AI | 0% but strong presence | Trained on elite analyst judgment, ecosystem-native |” MiniMax M2.5 · comparative prompt · alternative
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of five in this category shown.
“enterprise AI SOC solutions like Microsoft Security Copilot, ReliaQuest GreyMatter, or CrowdStrike Charlotte AI are often cost-prohibitive” Gemini 3.5 Flash · budget prompt · soft negative
“Microsoft Security Copilot — noted as having "several components still in preview" (feels incomplete in production)” DeepSeek V4 Flash · negative prompt · soft negative
“Limited effectiveness outside of Microsoft-native telemetry; currently more of a "chatbot" than a true agent.” Qwen 3.7 Flash · comparative prompt · soft negative
“I recommend Microsoft Security Copilot or Dropzone AI as your AI SOC analyst for alert triage” Mistral Small · paraphrase prompt · first choice
“Companies already standardized on Defender, Sentinel, Entra, and Microsoft 365 | Less compelling if your environment is vendor-diverse” Perplexity Sonar · paraphrase prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.