Chatbots and conversational AI for support
Asked as “customer support chatbot platform”, and as “conversational AI tool for customer service”, on behalf of a mid-market B2B company. 43 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
35%
Contested · Tidio 21%
35Intercom Fin AI Agent21Tidio07Zoho Desk37others
35% of first choices, contested.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the four products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Head to head
All ten head-to-head pages: the top five products, each against each
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08F09
Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01Intercom Fin AI Agent35%
Intercom Fin AI Agent35%02Tidio21%
Tidio21%03Freshdesk5%
Freshdesk5%04Zendesk AI2%
Zendesk AI2%05HubSpot Service Hub2%
HubSpot Service Hub2%06Ada0%
Ada0%07Gorgias AI Agent0%
Gorgias AI Agent0%08Botpress0%
Botpress0%09Freshchat0%
What they warned about
Four of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Gemini 3.5 Flash, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2 and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Zendesk AI23%
9 of 39 labels negative · 7 of 12 models · 1 hard negative
“What to Avoid on a Tight Budget: Zendesk - Starts at $55/agent/month, AI costs extra” Kimi K2, budget prompt
Intercom Fin AI Agent16%
7 of 44 labels negative · 5 of 12 models · 2 hard negative
“Avoid Intercom if you're a small business, need predictable costs, or can't tolerate usage-based billing surprises.” DeepSeek V4 Flash, negative prompt
Ada15%
3 of 20 labels negative · 2 of 12 models · 1 hard negative
“Platforms with Serious Red Flags (Avoid or Extreme Caution)... Ada... Described as a "complete scam company" by multiple users” Kimi K2, negative prompt
Chatfuel100%
2 of 2 labels negative · 2 of 12 models · 1 hard negative
“Avoid Chatfuel if you need reliable vendor support, multi-channel coverage, or sophisticated AI understanding.” DeepSeek V4 Flash, negative prompt
What they cite
Four of the twelve models returned a source list in this edition: four return the pages they cited.
Sites the answers cite
19 of 72 answers in this category came back with a source list, from 4 of 12 models: citations where the model returns them, or the search results it consulted. 254 links across 128 sites, every framing counted. Ranked by the number of answers carrying the site or page. The other 8 models searched through a gateway that returned no source list on this edition.
vendor site · Fin.ai8 answers · 8 citations · 3 models
vendor site · Zendesk8 answers · 8 citations · 4 models
vendor site · Featurebase7 answers · 8 citations · 3 models
vendor site · Capterra6 answers · 8 citations · 1 model
vendor site · Lindy6 answers · 7 citations · 3 models
6 answers · 7 citations · 3 models
vendor site · Botpress5 answers · 5 citations · 2 models
5 answers · 5 citations · 2 models
vendor site · Freshworks5 answers · 5 citations · 2 models
vendor site · Reddit5 answers · 5 citations · 2 models
vendor site · TeamSupport4 answers · 6 citations · 3 models
vendor site · Intercom4 answers · 5 citations · 2 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
6 answers · 3 models
5 answers · 1 model
5 answers · 3 models
5 answers · 2 models
5 answers · 2 models
4 answers · 2 models
4 answers · 1 model
4 answers · 3 models
3 answers · 2 models
3 answers · 2 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best customer support chatbot platform”, “customer support chatbot platform”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Intercom Fin AI Agent intercom.com | 35% | 159 | 210 | 3 | 64,348 | $3,304 | 120 | |
| Tidio tidio.com | 21% | 236 | 6,600 | 102 | 79,128 | 64 | ||
| Zoho parent site Zoho Desk 7%, Zoho SalesIQ 2% | 9% | 167 | 8,100 | 105 | ||||
| Freshworks freshworks.com Freshdesk 5%, Freshworks Freddy AI Agent 0% | 5% | 291 | 12,100 | 391 | 111,586 company | $14,486 | 113 | |
| TeamSupport teamsupport.com | 5% | 40 | 1,000 | 1 | 19,052 | 6 | ||
| Pylon usepylon.com | 5% | 36 | 40,500 | 3,118 | 29,726 | $166 | 21 | |
| Zendesk AI zendesk.com | 2% | 102 | 880 | 48 | 5,365,445 | $16,181 | 63 | 1 |
| HubSpot parent site HubSpot Service Hub 2% | 2% | 285 | 368,000 | 9,776 | ||||
| Plain plain.com | 2% | 8 | 90,500 | 83,095 | 1,314 | 0 | ||
| Decagon decagon.ai | 2% | 10 | 60,500 | 1,155 | 62,756 | $47,716 | 34 |
Google's top ten for the two searches hold 17 sites; 5 of them are among the sites the models cited here (eesel.ai, lindy.ai, reddit.com, thecxlead.com, zendesk.com). The first result for “best customer support chatbot platform” is twig.so.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best customer support chatbot platform for a mid-market B2B company?”Paraphrase“Which conversational AI tool for customer service would you recommend to a mid-sized B2B company?”Comparative“What are the top customer support chatbot platforms and how do they differ?”Budget-constrained“What is the best customer support chatbot platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a customer support chatbot platform. What should we look at?”Negative“Which customer support chatbot platforms should I avoid or be cautious about?”
Claude Haiku 4.5Plainagainst: Zendesk AIIntercom Fin AI Agent, Zendesk AIChangedagainst: Microsoft Bot FrameworkIntercom Fin AI AgentTidiono first choicenothing named
Two alternatives
Freshdesk, TeamSupportFour alternatives
Drift, Freshchat, Freshdesk, HubSpot Service HubFive alternatives
Ada, Freshdesk, Salesforce Agentforce for Service, Tidio, Zendesk AI AgentsThree alternatives
Chatbase, Chatling, eesel AIGPT-5.4 miniIntercom Fin AI AgentIntercom Fin AI AgentHeldZendesk AITidioagainst: Intercom Fin AI Agent, Zendesk AIno first choicenothing named
Three alternatives
Freshdesk, Freshworks Freddy AI Agent, Zendesk AIOne alternative
Zendesk AISeven alternatives
Ada, Freshchat, Freshdesk, Freshworks Freddy AI Agent, Gorgias AI Agent, Intercom Fin AI Agent, Salesforce Service CloudTwo alternatives
Crisp, Zoho SalesIQGemini 3.5 FlashPylonIntercom Fin AI Agent, Worknet AIChangedIntercom Fin AI AgentTidiono first choiceagainst: Intercom's Fin AI
Three alternatives
Ada, Intercom Fin AI Agent, TeamSupportThree alternatives
ClearFeed, Forethought, Zendesk AIFive alternatives
Ada, Botpress, Gorgias AI Agent, Zendesk AI, ZowieFour alternatives
Botpress, Chatbase, ManyChat, QuidgetSeven alternatives
Ada, Intercom Fin AI Agent, Kustomer KIQ, Sierra, Solvemate, Thankful, Zendesk AIPerplexity SonarIntercom Fin AI Agentagainst: Freshworks Freddy AI AgentIntercom Fin AI AgentHeldZendesk AITidiono first choiceagainst: Sobot AI Agents
Two alternatives
TeamSupport, Zendesk AITwo alternatives
Front, PylonSix alternatives
Ada, Freshchat, Freshworks Freddy AI Agent, Gorgias AI Agent, Intercom Fin AI Agent, TidioTwo alternatives
HubSpot Sales Hub, QuidgetGrok 4.20Intercom Fin AI Agentagainst: DriftIntercom Fin AI AgentHeldno first choiceTidioagainst: Intercom Fin AI Agent, ManyChat, Zendesk AIno first choiceagainst: Crisp, Drift, Intercom Fin AI Agent, LivePerson, ManyChat, Paradox.ai, Tidio, Yellow.ai
Three alternatives
Ada, Tidio, Zendesk AIThree alternatives
Freshdesk, Pylon, Zendesk AISix alternatives
Chatbase, Chatling, Freshchat, HubSpot Service Hub, ProProfs Chat, eesel AIFour alternatives
Ada, Infobip, Sierra, Zendesk AIMistral SmallIntercom Fin AI AgentHelplyChangedagainst: Zendesk AIno first choiceChatsyno first choiceagainst: Character.AI, ConverseNow Technologies, Google Cloud Contact Center AI
Four alternatives
Freshdesk, Fulcrum by Simple Machines, HubSpot Service Hub, Zendesk AITwo alternatives
Botpress, PlainFive alternatives
Freshchat, ProProfs Chat, Tidio, Zoho SalesIQ, tawk.toDeepSeek V4 FlashFreshdeskagainst: AdaIntercom Fin AI AgentChangedagainst: Zendesk AIIntercom Fin AI AgentTidio, Zoho DeskIntercom Fin AI Agentagainst: Chatfuel, Intercom Fin AI Agent, Zendesk AI Agents
Two alternatives
Intercom Fin AI Agent, Zendesk AIThree alternatives
Botpress, Freshworks Freddy AI Agent, TeamSupportEleven alternatives
Ada, Botpress, Freshdesk, Gorgias AI Agent, HubSpot Service Hub, Kore.ai, Rasa, Salesforce Agentforce for Service, Sierra, Tidio, Zendesk AI AgentsThree alternatives
Chatbase, Chatling, FreshdeskFour alternatives
Ada, Freshdesk, Freshworks Freddy AI Agent, Zendesk AILlama 4 MaverickTeamSupportno first choiceChangedno first choiceHelp Scout, Tidio, Zoho Deskno first choicenothing named
Three alternatives
Ada, Intercom Fin AI Agent, TidioQwen 3.7 FlashTeamSupportPylonChangedGorgias AI Agent, Intercom Fin AI AgentZoho SalesIQagainst: Lindy, Zendesk AIno first choiceagainst: Botpress, Chatfuel, Chatwoot, Drift, Freshdesk, HubSpot Conversations, Intercom Fin AI Agent, ManyChat, Rocket.Chat, Salesforce Service Cloud, Zoho Desk
Three alternatives
Intercom Fin AI Agent, Plain, Zendesk AITwo alternatives
Intercom Fin AI Agent, PlainSix alternatives
Ada, Chatbase, Freshdesk, Invent, Sierra, Zendesk AIThree alternatives
Freshdesk, ManyChat, TidioKimi K2Freshdeskagainst: Zendesk AIIntercom Fin AI AgentChangedagainst: Zendesk AIIntercom Fin AI Agentagainst: Salesforce Agentforce for Service, Tidio LyroTidioagainst: Intercom Fin AI Agent, Zendesk AIIntercom Fin AI Agentagainst: Ada, Decagon, Sierraagainst: Ada, ChatBot.com, DeepChat / Zenith AI / Sunly AI, Freshchat, Freshdesk, Gorgias AI Agent, Intercom Fin AI Agent, Vyro / Chatly / Imagine.art
Three alternatives
HubSpot Service Hub, Intercom Fin AI Agent, PlainTwo alternatives
Freshdesk, Salesforce Agentforce for ServiceFour alternatives
Ada, Freshdesk, Gorgias AI Agent, Zendesk AIOne alternative
Zoho SalesIQSix alternatives
Botsonic, Freshdesk, Freshworks Freddy AI Agent, HubSpot Breeze, SiteGPT, Zendesk AIGLM 4.7 FlashXIntercom Fin AI AgentIntercom Fin AI AgentHeldAda, Intercom Fin AI Agent, TidioZoho Deskno first choiceagainst: ServiceNow Now Assist, WotNot Platform
Three alternatives
Aissist.io, Decagon, Zendesk AIOne alternative
Zendesk AITwelve alternatives
Botpress, Crisp, Google Dialogflow CX, Gorgias AI Agent, HubSpot Service Hub, IBM Watson Assistant, Kore.ai, Rasa, Sierra, Zendesk AI, Zoho Desk, eesel AIFour alternatives
Chatling, Freshdesk, Tidio, eesel AIMiniMax M2.5Decagon, YourGPTHubSpot Service HubChangedIntercom Fin AI AgentTidiono first choicenothing named
Three alternatives
Intercom Fin AI Agent, TeamSupport, Zendesk AIOne alternative
ZobotEight alternatives
Botpress, Freshdesk, Gorgias AI Agent, Kore.ai, Rasa, Salesforce Agentforce for Service, Tidio Lyro, Zendesk AI AgentsFour alternatives
Crisp, HubSpot Free Tier, ManyChat, Zoho SalesIQBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 01:09 | yes | 12 | 9 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 01:10 | yes | 3 | 7 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 02:03 | yes | 17 | 25 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-15 00:14 | yes | 20 | 7 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-14 23:57 | yes | 0 | 9 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 03:30 | yes | 0 | 10 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-09-15 01:01 | yes | 0 | 63 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 01:09 | yes | 0 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-14 23:00 | yes | 0 | 26 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-14 22:57 | yes | 0 | 31 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 04:09 | yes | 0 | 64 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 02:53 | yes | 0 | 12 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 00:10 | no | 0 | 5 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 01:34 | yes | 2 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 01:20 | yes | 16 | 30 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-15 00:04 | yes | 20 | 6 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 05:01 | yes | 0 | 11 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 00:01 | yes | 0 | 7 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-09-15 04:14 | yes | 0 | 43 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-14 22:53 | yes | 0 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-15 01:00 | yes | 0 | 37 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-14 23:54 | yes | 0 | 25 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 03:30 | yes | 0 | 17 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 03:10 | yes | 0 | 17 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 01:51 | yes | 7 | 8 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 01:27 | yes | 3 | 7 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 04:30 | yes | 21 | 21 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-15 03:16 | yes | 20 | 14 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 03:35 | yes | 0 | 5 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-14 23:18 | yes | 0 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-09-15 00:42 | yes | 0 | 31 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-14 23:33 | yes | 0 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-15 00:10 | yes | 0 | 23 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-15 03:27 | yes | 0 | 31 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-14 23:49 | yes | 0 | 20 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 03:51 | yes | 0 | 15 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 02:28 | yes | 7 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-14 23:26 | no | 0 | 2 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-14 23:14 | yes | 10 | 18 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-15 01:53 | yes | 20 | 6 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 04:18 | yes | 0 | 7 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 03:55 | yes | 0 | 7 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-15 04:10 | yes | 0 | 14 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 01:22 | yes | 0 | 1 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-14 23:00 | yes | 0 | 17 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-15 04:39 | yes | 0 | 27 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 03:39 | yes | 0 | 49 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 04:29 | yes | 0 | 11 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 01:59 | no | 0 | 8 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 04:50 | no | 0 | 12 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 04:03 | no | 0 | 16 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-14 23:39 | yes | 20 | 7 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 04:37 | yes | 0 | 9 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 02:29 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-15 02:32 | yes | 0 | 19 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 01:22 | yes | 0 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-14 23:42 | yes | 0 | 32 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-15 03:57 | yes | 0 | 78 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 01:06 | yes | 0 | 22 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 00:40 | yes | 0 | 12 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-14 23:33 | yes | 7 | 8 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 04:35 | yes | 4 | 8 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-14 23:51 | yes | 25 | 25 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-15 03:28 | yes | 20 | 6 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 04:27 | yes | 0 | 8 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 01:33 | yes | 0 | 9 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-09-14 23:37 | yes | 0 | 35 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 01:28 | yes | 0 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-15 03:10 | no | 0 | 42 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-15 03:28 | yes | 0 | 62 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 00:38 | yes | 0 | 42 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 05:03 | yes | 0 | 23 s |
Noise floor in this category
Flips between the edition run and its calibration repeat. Six prompts per model is a small sample; the index-wide floor is the number to trust.
ShowHide
Claude Haiku 4.5
2 of 4 flipped
GPT-5.4 mini
2 of 4 flipped
Gemini 3.5 Flash
3 of 4 flipped
Perplexity Sonar
1 of 4 flipped
Grok 4.20
3 of 5 flipped
Mistral Small
4 of 4 flipped
DeepSeek V4 Flash
3 of 5 flipped
Llama 4 Maverick
2 of 2 flipped
Qwen 3.7 Flash
4 of 4 flipped
Kimi K2
5 of 6 flipped
GLM 4.7 FlashX
2 of 4 flipped
MiniMax M2.5
2 of 4 flipped
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Fin read as Intercom Fin AI Agent
Fin (Intercom) read as Intercom Fin AI Agent
Fin (by Intercom) read as Intercom Fin AI Agent
Freshdesk Freddy read as Freshdesk
Freshworks read as Freshworks Freddy AI Agent
Freshworks (Freddy AI) read as Freshworks Freddy AI Agent
Gorgias read as Gorgias AI Agent
HubSpot read as HubSpot Service Hub
HubSpot (Breeze AI) read as HubSpot Service Hub
Intercom read as Intercom Fin AI Agent
Intercom (Fin AI Agent) read as Intercom Fin AI Agent
Intercom (Fin AI) read as Intercom Fin AI Agent
Intercom (Fin) read as Intercom Fin AI Agent
Intercom (Powered by Fin AI Agent) read as Intercom Fin AI Agent
Intercom (w/ Fin AI) read as Intercom Fin AI Agent
Intercom (with Fin AI Agent) read as Intercom Fin AI Agent
Intercom (with Fin AI) read as Intercom Fin AI Agent
Intercom (with its Fin AI agent) read as Intercom Fin AI Agent
Intercom Fin read as Intercom Fin AI Agent
Salesforce Agentforce read as Salesforce Agentforce for Service
Sobot read as Sobot AI Agents
Zendesk read as Zendesk AI
Unresolved, counted raw
Aissist.io
Chatbot Builder AI
Customerly
DeepChat / Zenith AI / Sunly AI
Fulcrum by Simple Machines
Intercom's Fin AI
Invent
Kustomer KIQ
Minami
Paradox.ai
ServiceNow Now Assist
Solvemate
Thankful
Vyro / Chatly / Imagine.art
WotNot Platform
Zobot (Zoho SalesIQ)
Discontinued, still offered
No shut-down product was recommended here.