Email security
Asked as “email security platform”, and as “phishing and email threat protection tool”, on behalf of a mid-market B2B company. 57 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
32%
Contested · Abnormal AI 12%
32Microsoft Defender for Office 36512Abnormal AI12Proofpoint Email Protection44others
32% of first choices, contested.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the one product at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Head to head
All twenty-eight head-to-head pages: the top eight products, each against each
Microsoft Defender for Office 365 vs IRONSCALESMicrosoft Defender for Office 365 vs Mimecast Email SecurityMicrosoft Defender for Office 365 vs Barracuda Email ProtectionMicrosoft Defender for Office 365 vs SpamTitanAbnormal AI vs Proofpoint Email ProtectionAbnormal AI vs Check Point Harmony Email & CollaborationAbnormal AI vs IRONSCALESAbnormal AI vs Mimecast Email SecurityAbnormal AI vs Barracuda Email ProtectionAbnormal AI vs SpamTitanProofpoint Email Protection vs Check Point Harmony Email & CollaborationProofpoint Email Protection vs IRONSCALESProofpoint Email Protection vs Mimecast Email SecurityProofpoint Email Protection vs Barracuda Email ProtectionProofpoint Email Protection vs SpamTitanCheck Point Harmony Email & Collaboration vs IRONSCALESCheck Point Harmony Email & Collaboration vs Mimecast Email SecurityCheck Point Harmony Email & Collaboration vs Barracuda Email ProtectionCheck Point Harmony Email & Collaboration vs SpamTitanIRONSCALES vs Mimecast Email SecurityIRONSCALES vs Barracuda Email ProtectionIRONSCALES vs SpamTitanMimecast Email Security vs Barracuda Email ProtectionMimecast Email Security vs SpamTitanBarracuda Email Protection vs SpamTitan
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08
09
10Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01Microsoft Defender for Office 36532%
Microsoft Defender for Office 36532%02Abnormal AI12%
Abnormal AI12%03Proofpoint Email Protection12%
Proofpoint Email Protection12%04Check Point Harmony Email & Collaboration11%
Check Point Harmony Email & Collaboration11%05IRONSCALES9%
IRONSCALES9%06Mimecast Email Security7%
Mimecast Email Security7%07Barracuda Email Protection7%
Barracuda Email Protection7%08SpamTitan5%
SpamTitan5%09Sublime Security2%
Sublime Security2%10Cisco Secure Email0%
Cisco Secure Email0%What they warned about
Zero of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.20, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Mimecast Email Security13%
6 of 45 labels negative · 6 of 12 models
“it has experienced security breaches in the past, including a certificate compromise... This has led some organizations to approach Mimecast with caution.” Mistral Small, negative prompt
AOL Mail100%
4 of 4 labels negative · 4 of 12 models · 3 hard negative
“Yahoo Mail and AOL Mail are considered to be insecure and should be avoided” Llama 4 Maverick, negative prompt
Proofpoint Email Protection12%
6 of 50 labels negative · 4 of 12 models
“Proofpoint is priced and configured for enterprise environments with significant operational complexity... it just may not be suitable for smaller organizations.” Claude Haiku 4.5, negative prompt
Yahoo Mail100%
3 of 3 labels negative · 3 of 12 models · 3 hard negative
“Yahoo Mail and AOL Mail are considered to be insecure and should be avoided due to their history of data breaches” Llama 4 Maverick, negative prompt
What they cite
Twelve of the twelve models returned a source list in this edition: four return the pages they cited and eight the search results they consulted.
Sites the answers cite
64 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 948 links across 230 sites, every framing counted. Ranked by the number of answers carrying the site or page.
47 answers · 53 citations · 12 models
30 answers · 39 citations · 11 models
vendor site · Sublime26 answers · 32 citations · 10 models
23 answers · 23 citations · 9 models
vendor site · IRONSCALES22 answers · 25 citations · 9 models
vendor site · Kaseya20 answers · 20 citations · 10 models
vendor site · Barracuda19 answers · 21 citations · 11 models
vendor site · Proofpoint17 answers · 25 citations · 7 models
vendor site · G217 answers · 17 citations · 10 models
vendor site · Check Point15 answers · 17 citations · 11 models
vendor site · G213 answers · 22 citations · 6 models
13 answers · 22 citations · 7 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
43 answers · 11 models
23 answers · 9 models
20 answers · 10 models
18 answers · 9 models
17 answers · 10 models
15 answers · 10 models
15 answers · 8 models
13 answers · 7 models
13 answers · 8 models
11 answers · 10 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best email security platform”, “email security platform”, “email security platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Microsoft Defender parent site Microsoft Defender for Office 365 32% | 32% | 166 | 18,100 | 3,525 | ||||
| Abnormal abnormal.ai Abnormal AI 12% | 12% | 107 | 8,100 | 130 | 30,467 company | $6 | 120 | |
| Proofpoint proofpoint.com Proofpoint Email Protection 12% | 12% | 164 | 27,100 | 1,488 | 593,092 company | $9,336 | 43 | 4 |
| Check Point parent site Check Point Harmony Email & Collaboration 11% | 11% | 79 | 14,800 | 4,487 | ||||
| IRONSCALES ironscales.com | 9% | 66 | 1,900 | 28 | 10,997 | 22 | 5 | |
| Mimecast mimecast.com Mimecast Email Security 7% | 7% | 134 | 320 | 17 | 148,929 company | 21 | ||
| Barracuda barracuda.com Barracuda Email Protection 7% | 7% | 100 | 201,000 | 10,561 | 64,778 company | 116 | 4 | |
| SpamTitan spamtitan.com | 5% | 22 | 590 | 22 | 4,190 | |||
| Sublime Security sublime.security | 2% | 23 | 2,900 | 27 | 6,558 | 26 | 2 | |
| Google Workspace google.com | 2% | 53 | 368,000 | 7,422 | 1,800,358,416 | $465,944 | 5 |
Google's top ten for the three searches hold 15 sites; 6 of them are among the sites the models cited here (barracuda.com, gartner.com, ironscales.com, proofpoint.com, reddit.com, sublime.security). The first result for “best email security platform” is gartner.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best email security platform for a mid-market B2B company?”Paraphrase“Which phishing and email threat protection tool would you recommend to a mid-sized B2B company?”Comparative“What are the top email security platforms and how do they differ?”Budget-constrained“What is the best email security platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating an email security platform. What should we look at?”Negative“Which email security platforms should I avoid or be cautious about?”
Claude Haiku 4.5Barracuda Email Protectionagainst: Proofpoint Email ProtectionIRONSCALESChangedBarracuda Email ProtectionSpamTitanno first choiceagainst: Proofpoint Email Protection, Salesloft Drift
Two alternatives
Abnormal AI, Check Point Harmony Email & CollaborationTwo alternatives
Barracuda Email Protection, Sophos EmailFive alternatives
Abnormal AI, Check Point Harmony Email & Collaboration, Mimecast Email Security, Proofpoint Email Protection, Sophos EmailTwo alternatives
Barracuda Email Protection, Microsoft Defender for Office 365GPT-5.4 miniMicrosoft Defender for Office 365Microsoft Defender for Office 365, Proofpoint Email ProtectionChangedno first choiceMicrosoft Defender for Office 365no first choicenothing named
One alternative
Proofpoint Email ProtectionSeven alternatives
Abnormal AI, Check Point Harmony Email & Collaboration, Cisco Secure Email, Darktrace EMAIL, Microsoft Defender for Office 365, Mimecast Email Security, Proofpoint Email ProtectionThree alternatives
Check Point Harmony Email & Collaboration, Google Workspace, Proofpoint Email ProtectionGemini 3.5 FlashAbnormal AI, Check Point Harmony Email & CollaborationCheck Point Harmony Email & CollaborationChangedagainst: Abnormal AI, Mimecast Email Security, Proofpoint Email Protectionno first choiceSublime Securityagainst: Abnormal AIAbnormal AI, Check Point Harmony Email & Collaborationagainst: AOL Mail, Apple iCloud Mail, Cisco Secure Email, Gmail, Google Workspace, Hushmail, Microsoft 365 EOP, Outlook, Skiff Mail, Symantec Email Security.cloud, Trellix, Yahoo
Three alternatives
IRONSCALES, Sophos Email, Sublime SecurityOne alternative
IRONSCALESSix alternatives
Abnormal AI, Check Point Harmony Email & Collaboration, Microsoft Defender for Office 365, Mimecast Email Security, Proofpoint Email Protection, Sublime SecurityFour alternatives
Check Point Harmony Email & Collaboration, IRONSCALES, Microsoft Defender for Office 365, SpamTitanFour alternatives
IRONSCALES, Mimecast Email Security, Proofpoint Email Protection, Sublime SecurityPerplexity SonarMimecast Email SecurityMicrosoft Defender for Office 365Changedno first choiceMicrosoft Defender for Office 365no first choiceagainst: AOL Mail, Barracuda Email Protection, Gmail, Microsoft, Outlook, Yahoo Mail
One alternative
Proofpoint Email ProtectionTwo alternatives
Abnormal AI, Barracuda Email ProtectionTwo alternatives
Barracuda Email Protection, SpamTitanGrok 4.20Mimecast Email Security, Proofpoint Email Protectionagainst: Microsoft Defender for Office 365Microsoft Defender for Office 365, Proofpoint Email ProtectionChangedProofpoint Email ProtectionMicrosoft Defender for Office 365no first choiceagainst: AOL Mail, Appriver, Barracuda Email Security Gateway, FortiMail, Microsoft 365, Microsoft Defender for Office 365, SonicWall, Sophos Email, Yahoo Mail
Two alternatives
Abnormal AI, Barracuda Email ProtectionTwo alternatives
Abnormal AI, Mimecast Email SecurityFour alternatives
Abnormal AI, Check Point Harmony Email & Collaboration, Microsoft Defender for Office 365, Mimecast Email SecurityThree alternatives
Barracuda Email Protection, Proofpoint Email Protection, SpamTitanSix alternatives
Abnormal AI, Cloudflare Email Security, Microsoft Defender for Office 365, Mimecast Email Security, Proofpoint Email Protection, Trend Micro Email SecurityMistral SmallBarracuda Email Protection, Proofpoint Email ProtectionMimecast Email Security, Proofpoint Email ProtectionChangedno first choiceCheck Point Harmony Email & Collaborationno first choiceagainst: Barracuda Email Protection, Mimecast Email Security
Two alternatives
Abnormal AI, Mimecast Email SecurityFour alternatives
Abnormal AI, Barracuda Email Security Gateway, Cisco Secure Email, Microsoft Defender for Office 365Three alternatives
Barracuda Email Protection, Microsoft Defender for Office 365, SpamTitanDeepSeek V4 FlashAbnormal AI, Check Point Harmony Email & Collaboration, IRONSCALESIRONSCALES, Microsoft Defender for Office 365ChangedProofpoint Email ProtectionMicrosoft Defender for Office 365Abnormal AIagainst: Proofpoint Email Protectionagainst: Barracuda Email Security Gateway, Microsoft Defender for Office 365, Mimecast Email Security, SpamTitan
Three alternatives
Barracuda Email Protection, Microsoft Defender for Office 365, Proofpoint Email ProtectionOne alternative
Abnormal AIFive alternatives
Abnormal AI, Barracuda Email Security Gateway, Google Workspace, Microsoft Defender for Office 365, Mimecast Email SecurityThree alternatives
Barracuda Email Security Gateway, Proofpoint Email Protection, SpamTitanTwo alternatives
Microsoft Defender for Office 365, Mimecast Email SecurityLlama 4 MaverickBarracuda Email ProtectionTrustmiChangedno first choiceMicrosoft Defender for Office 365no first choiceagainst: AOL Mail, Gmail, Hotmail, Microsoft Outlook, Yahoo Mail, iCloud Mail
Three alternatives
IRONSCALES, Proofpoint Email Protection, SpamTitanOne alternative
ControlDOne alternative
Acronis Cyber ProtectQwen 3.7 FlashMicrosoft Defender for Office 365Proofpoint Email ProtectionChangedMicrosoft Defender for Office 365Microsoft Defender for Office 365, SpamTitanAbnormal AIagainst: Mimecast Email Securityagainst: McAfee Total Protection, Windows Defender standalone
Four alternatives
Abnormal AI, Barracuda Email Protection, Mimecast Email Security, Proofpoint Email ProtectionThree alternatives
KnowBe4, Red Sift, Vade SecureFive alternatives
Abnormal AI, Check Point Harmony Email & Collaboration, IRONSCALES, Mimecast Email Security, Proofpoint Email ProtectionTwo alternatives
Proofpoint Email Protection, Sophos EmailThree alternatives
Barracuda Email Protection, Proofpoint Email Protection, ValimailKimi K2Abnormal AI, IRONSCALESagainst: Proofpoint Email ProtectionAbnormal AI, Barracuda Email ProtectionChangedAbnormal AI, IRONSCALES, Material Securityagainst: Microsoft Defender for Office 365Microsoft Defender for Office 365, SpamTitanMicrosoft Defender for Office 365against: Barracuda Email Security Gateway, Check Point Harmony Email & Collaboration, Cisco Secure Email, Libraesva Email Security Gateway, Mimecast Email Security, Proofpoint Email Protection
Three alternatives
Barracuda Email Protection, Microsoft Defender for Office 365, Mimecast Email SecurityTwo alternatives
KnowBe4, Mimecast Email SecurityTwo alternatives
Proofpoint Email Protection, TrustifiThree alternatives
Abnormal AI, Google Workspace, Material SecurityGLM 4.7 FlashXMimecast Email SecurityMicrosoft Defender for Office 365ChangedAbnormal AIGoogle Workspace, Microsoft Defender for Office 365no first choiceagainst: Bitdefender Email Security, Check Point Harmony Email & Collaboration, Cisco Secure Email, Libraesva Email Security Gateway, Mimecast Email Security
Four alternatives
Abnormal AI, Barracuda Email Protection, Egress, IRONSCALESThree alternatives
Barracuda Email Protection, Mimecast Email Security, Proofpoint Email ProtectionFive alternatives
Barracuda Email Protection, Egress, Microsoft Defender for Office 365, Mimecast Email Security, Proofpoint Email ProtectionThree alternatives
Proofpoint Email Protection, Sophos Email, SpamTitanMiniMax M2.5Microsoft Defender for Office 365, Proofpoint Email ProtectionCheck Point Harmony Email & Collaboration, IRONSCALESChangedProofpoint Email ProtectionMicrosoft Defender for Office 365no first choiceagainst: Darktrace EMAIL, Microsoft
Two alternatives
Abnormal AI, Mimecast Email SecurityTwo alternatives
Abnormal AI, Barracuda Email ProtectionFour alternatives
Barracuda Email Protection, Microsoft Defender for Office 365, Mimecast Email Security, Sublime SecurityFour alternatives
Cloudflare Email Security, ESET Mail Security, Google Workspace, SpamTitanBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:20 | yes | 9 | 9 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:46 | yes | 3 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 13:39 | yes | 17 | 28 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-17 14:14 | yes | 20 | 6 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:22 | yes | 24 | 12 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:28 | yes | 8 | 7 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:21 | yes | 27 | 26 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 13:11 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 11:13 | yes | 8 | 40 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 12:18 | yes | 20 | 63 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 10:38 | yes | 41 | 80 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:19 | yes | 5 | 17 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:02 | yes | 16 | 13 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:25 | yes | 2 | 6 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:02 | yes | 16 | 23 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-17 11:58 | yes | 20 | 4 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 13:45 | yes | 20 | 10 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:58 | yes | 5 | 5 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 10:40 | yes | 10 | 15 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:55 | yes | 5 | 3 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:43 | yes | 10 | 42 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 12:45 | yes | 10 | 22 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:55 | yes | 10 | 16 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:22 | yes | 8 | 34 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:44 | yes | 14 | 10 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:03 | yes | 7 | 11 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:14 | yes | 22 | 23 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-17 13:39 | yes | 18 | 11 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 11:30 | yes | 29 | 13 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 10:29 | yes | 9 | 10 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:51 | yes | 18 | 31 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:59 | yes | 5 | 3 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 13:15 | yes | 5 | 21 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 13:57 | yes | 9 | 24 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 11:07 | yes | 29 | 130 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 10:01 | yes | 10 | 28 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:46 | yes | 9 | 8 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:06 | no | 0 | 3 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:51 | yes | 19 | 20 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-17 13:27 | yes | 20 | 4 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:24 | yes | 37 | 15 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:24 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:37 | yes | 8 | 13 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:04 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:03 | yes | 10 | 54 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:40 | yes | 15 | 35 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 11:17 | yes | 13 | 179 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 13:35 | no | 0 | 11 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 11:01 | no | 0 | 6 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:16 | no | 0 | 11 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 13:18 | yes | 11 | 25 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-17 12:26 | yes | 20 | 9 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:03 | yes | 24 | 14 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 12:24 | no | 0 | 6 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 11:12 | yes | 15 | 25 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 14:06 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 09:40 | no | 0 | 43 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 13:38 | yes | 10 | 72 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:10 | yes | 14 | 101 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 09:37 | yes | 5 | 10 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 14:03 | yes | 18 | 9 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:31 | no | 0 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 13:34 | yes | 17 | 24 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-17 13:59 | yes | 20 | 6 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 09:53 | yes | 40 | 17 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:44 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:02 | yes | 29 | 42 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 09:29 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:27 | no | 0 | 42 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 12:47 | yes | 30 | 47 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 14:04 | yes | 31 | 38 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:51 | yes | 14 | 29 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
AOL read as AOL Mail
Abnormal read as Abnormal AI
Barracuda read as Barracuda Email Protection
Barracuda Email read as Barracuda Email Protection
Check Point read as Check Point Harmony Email & Collaboration
Check Point (Avanan) read as Check Point Harmony Email & Collaboration
Check Point Harmony read as Check Point Harmony Email & Collaboration
Check Point Harmony Email read as Check Point Harmony Email & Collaboration
Cisco read as Cisco Secure Email
Cloudflare read as Cloudflare Email Security
Cloudflare Area 1 read as Cloudflare Email Security
Darktrace read as Darktrace EMAIL
Google Workspace Security read as Google Workspace
Google Workspace security read as Google Workspace
Material read as Material Security
Microsoft Defender read as Microsoft Defender for Office 365
Mimecast read as Mimecast Email Security
Proofpoint read as Proofpoint Email Protection
Proofpoint Essentials read as Proofpoint Email Protection
Proofpoint Threat Protection read as Proofpoint Email Protection
Sophos read as Sophos Email
Sublime read as Sublime Security
TitanHQ read as SpamTitan
Trend Micro read as Trend Micro Email Security
Unresolved, counted raw
Apple iCloud Mail
Bitdefender Email Security
ESET Mail Security
Google Workspace Advanced Protection
Hushmail
McAfee Total Protection
Microsoft 365 EOP
Red Sift
Salesloft Drift
Skiff Mail
Skyhigh / IronPort (Cisco)
Trustmi
Vade Secure
Windows Defender standalone
Discontinued, still offered
No shut-down product was recommended here.