Customer identity and access management
Asked as “customer identity platform”, and as “CIAM solution for a product's users”, on behalf of a mid-market B2B company. 54 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
22%
Contested · WorkOS AuthKit 22%
22Auth022WorkOS AuthKit17Frontegg39others
22% of first choices, contested.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the five products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All twenty-eight head-to-head pages: the top eight products, each against each
Auth0 vs Microsoft Entra External IDAuth0 vs Ping IdentityAuth0 vs FusionAuthAuth0 vs Amazon CognitoWorkOS AuthKit vs FronteggWorkOS AuthKit vs ClerkWorkOS AuthKit vs Microsoft Entra External IDWorkOS AuthKit vs Ping IdentityWorkOS AuthKit vs FusionAuthWorkOS AuthKit vs Amazon CognitoFrontegg vs ClerkFrontegg vs Microsoft Entra External IDFrontegg vs Ping IdentityFrontegg vs FusionAuthFrontegg vs Amazon CognitoClerk vs Microsoft Entra External IDClerk vs Ping IdentityClerk vs FusionAuthClerk vs Amazon CognitoMicrosoft Entra External ID vs Ping IdentityMicrosoft Entra External ID vs FusionAuthMicrosoft Entra External ID vs Amazon CognitoPing Identity vs FusionAuthPing Identity vs Amazon CognitoFusionAuth vs Amazon Cognito
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08
09
10
11
12
13
14Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative40%
Key
01Auth022%
Auth022%02WorkOS AuthKit22%
WorkOS AuthKit22%03Frontegg17%
Frontegg17%04Clerk7%
Clerk7%05Microsoft Entra External ID4%
Microsoft Entra External ID4%06Ping Identity4%
Ping Identity4%07FusionAuth4%
FusionAuth4%08Amazon Cognito4%
Amazon Cognito4%09LoginRadius2%
LoginRadius2%10Descope0%
Descope0%11Stytch0%
Stytch0%12ForgeRock Identity Platform0%
ForgeRock Identity Platform0%13Keycloak0%
Keycloak0%14IBM Verify0%
IBM Verify0%What they warned about
Three of twelve models held their first choice under the paraphrase. Gemini 3.5 Flash, Grok 4.20, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Auth022%
15 of 67 labels negative · 8 of 12 models · 2 hard negative
“Developers report massive price increases of 300% to 1,500% on renewal” DeepSeek V4 Flash, negative prompt
Amazon Cognito28%
7 of 25 labels negative · 7 of 12 models
“generally not recommended for highly regulated industries or enterprise-grade governance without significant customization” GLM 4.7 FlashX, negative prompt
Keycloak33%
5 of 15 labels negative · 4 of 12 models · 2 hard negative
“Avoid self-hosting Keycloak unless you have a dedicated, experienced DevOps and Security team” Gemini 3.5 Flash, negative prompt
IDMerit100%
3 of 3 labels negative · 3 of 12 models · 2 hard negative
“IDmerit: MongoDB exposure of ~1 billion KYC records (November 2025)” Kimi K2, negative prompt
What they cite
Twelve of the twelve models returned a source list in this edition: four return the pages they cited and eight the search results they consulted.
Sites the answers cite
65 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 980 links across 233 sites, every framing counted. Ranked by the number of answers carrying the site or page.
36 answers · 36 citations · 11 models
vendor site · LoginRadius29 answers · 37 citations · 10 models
28 answers · 43 citations · 11 models
vendor site · Guideflow26 answers · 26 citations · 11 models
23 answers · 36 citations · 9 models
23 answers · 29 citations · 8 models
vendor site · Descope20 answers · 21 citations · 8 models
vendor site · WorkOS19 answers · 27 citations · 8 models
18 answers · 25 citations · 10 models
16 answers · 19 citations · 9 models
14 answers · 17 citations · 10 models
vendor site · Ping Identity12 answers · 19 citations · 8 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
34 answers · 10 models
26 answers · 11 models
18 answers · 8 models
17 answers · 9 models
14 answers · 10 models
14 answers · 8 models
13 answers · 8 models
12 answers · 9 models
12 answers · 7 models
12 answers · 7 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best customer identity platform”, “customer identity platform”, “customer identity platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Auth0 auth0.com Auth0 22%, Auth0/Okta Customer Identity Cloud 0% | 22% | 245 | 18,100 | 772 | 170,673 | 117 | ||
| WorkOS AuthKit workos.com | 22% | 74 | 33,478 | 75 | ||||
| Frontegg frontegg.com | 17% | 83 | 720 | 4 | 19,060 | 10 | ||
| Clerk clerk.com | 7% | 62 | 110,000 | 59,082 | 46,225 | 12 | ||
| Supabase Auth supabase.com | 6% | 19 | 1,900 | 62 | 91,424 | 4 | ||
| Microsoft parent site Microsoft Entra External ID 4%, Microsoft Entra ID 2% | 6% | 499 | 2,240,000 | 403,136 | ||||
| Ping pingidentity.com Ping Identity 4%, ForgeRock Identity Platform 0% | 4% | 264 | 12,100 | 249 | 73,959 company | $30 | 55 | 5 |
| FusionAuth fusionauth.io | 4% | 49 | 1,300 | 21 | 44,199 | 16 | ||
| Amazon parent site Amazon Cognito 4% | 4% | 82 | 151,000,000 | 1,380,939 | ||||
| LoginRadius loginradius.com | 2% | 37 | 170 | 7 | 39,709 | 3 | 1 |
Google's top ten for the three searches hold 25 sites; 3 of them are among the sites the models cited here (loginradius.com, pingidentity.com, startwithidentity.com). The first result for “best customer identity platform” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best customer identity platform for a mid-market B2B company?”Paraphrase“Which CIAM solution for a product's users would you recommend to a mid-sized B2B company?”Comparative“What are the top customer identity platforms and how do they differ?”Budget-constrained“What is the best customer identity platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a customer identity platform. What should we look at?”Negative“Which customer identity platforms should I avoid or be cautious about?”
Claude Haiku 4.5FronteggFronteggHeldno first choiceFusionAuthagainst: Amazon Cognitono first choiceagainst: Aura, IBM Verify
Two alternatives
Stytch, Thales OneWelcomeFour alternatives
Amazon Cognito, Auth0, Descope, Microsoft Entra External IDThree alternatives
Frontegg, Google Cloud Identity, SuperTokensGPT-5.4 miniAuth0Auth0Heldagainst: Amazon Cognito, Microsoft Entra External IDAuth0/Okta Customer Identity CloudClerk, Supabase Authagainst: Auth0no first choicenothing named
Two alternatives
FusionAuth, WorkOS AuthKitOne alternative
PingOne for CustomersSix alternatives
ForgeRock Identity Platform, LoginRadius, Microsoft Entra External ID, OneLogin, Ping Identity, SAP Customer Data CloudOne alternative
FusionAuthGemini 3.5 FlashWorkOS AuthKitagainst: Auth0Frontegg, WorkOS AuthKitChangedagainst: Auth0no first choiceWorkOS AuthKitagainst: Auth0, Firebase AuthenticationScaleKit, WorkOS AuthKitagainst: Auth0against: Amazon Cognito, Auth0, Firebase Authentication, Keycloak, Microsoft Entra External ID
Two alternatives
Frontegg, PropelAuthThree alternatives
Descope, SSOJet, ScaleKitNine alternatives
Auth0, Clerk, Descope, Frontegg, Keycloak, Microsoft Entra External ID, Ping Identity, WorkOS AuthKit, ZitadelFive alternatives
Clerk, Keycloak, Kinde, Logto, Supabase AuthFive alternatives
Clerk, Descope, Frontegg, Microsoft Entra External ID, StytchPerplexity SonarWorkOS AuthKitWorkOS AuthKitHeldAuth0/Okta Customer Identity CloudAmazon Cognitoagainst: Clerk, WorkOS AuthKit, miniOrangeno first choiceagainst: Amazon Cognito, FusionAuth, Google Cloud Identity, Keycloak, WorkOS AuthKit
Three alternatives
Auth0, Clerk, FronteggFour alternatives
Auth0, Descope, Frontegg, Microsoft Entra External IDFour alternatives
Amazon Cognito, ForgeRock Identity Platform, Microsoft Entra External ID, Ping IdentityOne alternative
LoginRadiusGrok 4.20Frontegg, WorkOS AuthKitagainst: Auth0, FusionAuth, Keycloak, Ping/ForgeRockWorkOS AuthKitChangedagainst: Auth0no first choiceAmazon Cognito, Clerk, Supabase Authagainst: Auth0no first choiceagainst: Amazon Cognito, Descope, Firebase Authentication, IBM Verify, IDMerit, IDScan.net, Keycloak, Okta/Auth0, Revolut
Three alternatives
Auth0, Descope, Microsoft Entra External IDFour alternatives
Auth0, Frontegg, LoginRadius, StytchThree alternatives
Firebase Authentication, FusionAuth, KeycloakMistral SmallAuth0, Ping IdentityAuth0, WorkOS AuthKitChangedAuth0Auth0no first choiceagainst: Keycloak, Ping Identityagainst: Experian, LiveRamp
Two alternatives
Frontegg, TealiumThree alternatives
Descope, LoginRadius, Microsoft Entra External IDSix alternatives
Amazon Cognito, Clerk, Descope, MojoAuth, Stytch, SuperTokensDeepSeek V4 FlashWorkOS AuthKitAuth0Changedagainst: Microsoft Entra External IDAuth0Auth0, Microsoft Entra External IDno first choiceagainst: Auth0, Okta, OneLogin, Ping Identity / ForgeRock, SAP Customer Data Cloud
Three alternatives
Auth0, Frontegg, StytchThree alternatives
Frontegg, Keycloak, WorkOS AuthKitSeven alternatives
Clerk, Frontegg, FusionAuth, Keycloak, Microsoft Entra External ID, Ping Identity, WorkOS AuthKitTwo alternatives
Descope, WorkOS AuthKitLlama 4 MaverickAuth0, Frontegg, Ping IdentityLoginRadiusChangedno first choiceMicrosoft Entra ID, OneLoginno first choicenothing named
Three alternatives
Hightouch, Tealium, Twilio SegmentOne alternative
SecureAuthThree alternatives
Auth0, Descope, LoginRadiusQwen 3.7 FlashAuth0, Clerkagainst: OktaAuth0ChangedAuth0Firebase Authenticationagainst: Auth0no first choiceagainst: IBM Verify, Oracleagainst: CA Siteminder, CyberArk Customer Identity, ForgeRock Identity Platform, HYPR, OneLogin, Oracle Access Manager, SailPoint
Two alternatives
Microsoft Entra, SuperTokensFour alternatives
Descope, LoginRadius, Microsoft Entra External ID, StytchFive alternatives
Amazon Cognito, Frontegg, Microsoft Entra External ID, Ping Identity, WorkOS AuthKitFour alternatives
Amazon Cognito, Clerk, Keycloak, KindeFour alternatives
Amazon Cognito, Auth0, Clerk, DuendeKimi K2FronteggFrontegg, KindeChangedagainst: Auth0/OktaAuth0Supabase Authagainst: Amazon Cognito, Auth0no first choiceagainst: IDMerit, Okta/Auth0, Ping Identity / ForgeRock, SAP Customer Data Cloud, Salesforce, Sumsub
Three alternatives
Auth0, Stytch, WorkOS AuthKitTwo alternatives
FusionAuth, WorkOS AuthKitSix alternatives
Amazon Cognito, Clerk, Frontegg, Microsoft Entra External ID, Ping Identity, StytchTwo alternatives
Clerk, Firebase AuthenticationGLM 4.7 FlashXWorkOS AuthKitFrontegg, WorkOS AuthKitChangedagainst: Clerk, Descope, LoginRadius, Ping IdentityAuth0FusionAuth, Microsoft Entra External IDno first choiceagainst: AU10TIX, Amazon Cognito, Auth0, IDMerit, IDnow.io, OneLogin, Persona, Sumsub, Veriff
Two alternatives
Auth0, FronteggThree alternatives
Auth0, FusionAuth, Microsoft Entra External IDFive alternatives
Amazon Cognito, Clerk, Frontegg, Microsoft Entra External ID, WorkOS AuthKitThree alternatives
Auth0, Descope, JumpCloudMiniMax M2.5Auth0, Fronteggagainst: Ping IdentityAuth0ChangedAuth0Clerkagainst: Auth0no first choicenothing named
Three alternatives
Descope, Frontegg, WorkOS AuthKitFour alternatives
ForgeRock Identity Platform, LoginRadius, Microsoft Entra External ID, Ping IdentityFour alternatives
Firebase Authentication, Logto, Supabase Auth, SuperTokensBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 12:26 | yes | 9 | 7 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 09:47 | yes | 3 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:46 | yes | 16 | 31 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-17 12:51 | yes | 20 | 5 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:43 | yes | 38 | 20 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 14:02 | yes | 5 | 3 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:08 | yes | 10 | 14 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:16 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:32 | no | 0 | 39 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 13:49 | yes | 12 | 28 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:48 | yes | 25 | 143 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:49 | yes | 9 | 21 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:58 | yes | 9 | 10 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 10:52 | yes | 2 | 6 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 09:32 | yes | 15 | 24 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-17 13:50 | yes | 20 | 5 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 13:28 | yes | 24 | 15 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:26 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 09:26 | yes | 10 | 14 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:05 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:52 | yes | 5 | 26 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 14:04 | yes | 10 | 21 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:32 | yes | 16 | 68 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 09:27 | yes | 17 | 77 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:45 | yes | 9 | 8 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 13:40 | yes | 6 | 10 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 11:49 | yes | 18 | 33 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-17 11:01 | yes | 20 | 8 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 11:26 | yes | 35 | 15 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 12:59 | yes | 5 | 8 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 14:01 | yes | 29 | 31 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 10:28 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 11:45 | yes | 9 | 28 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:39 | yes | 14 | 31 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 11:56 | yes | 24 | 44 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:40 | yes | 10 | 24 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:30 | yes | 9 | 8 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:07 | yes | 4 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:03 | yes | 21 | 44 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-17 14:12 | yes | 20 | 6 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 12:37 | yes | 48 | 19 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 13:46 | yes | 10 | 8 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 10:19 | yes | 10 | 11 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 14:05 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:01 | no | 0 | 39 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 09:45 | yes | 15 | 44 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:40 | yes | 30 | 45 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 12:18 | yes | 20 | 46 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 13:05 | no | 0 | 7 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 12:50 | no | 0 | 9 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 10:38 | yes | 9 | 22 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-17 13:24 | yes | 20 | 5 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 10:07 | yes | 24 | 10 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 09:34 | no | 0 | 9 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-09-17 13:14 | yes | 15 | 30 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 11:17 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 12:55 | no | 0 | 36 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:26 | yes | 20 | 36 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 12:32 | yes | 24 | 177 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 11:28 | yes | 9 | 23 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-17 10:30 | yes | 18 | 9 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-17 11:52 | no | 0 | 3 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-17 12:53 | yes | 15 | 27 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-17 11:48 | yes | 20 | 9 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-17 09:42 | yes | 23 | 12 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-17 12:41 | yes | 5 | 8 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-17 12:59 | yes | 25 | 35 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-17 09:51 | yes | 9 | 4 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-17 10:33 | yes | 10 | 68 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-17 11:28 | yes | 30 | 30 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-17 13:59 | yes | 28 | 326 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-17 13:32 | yes | 5 | 16 s |
Noise floor in this category
Flips between the edition run and its calibration repeat. Six prompts per model is a small sample; the index-wide floor is the number to trust.
ShowHide
Claude Haiku 4.5
2 of 3 flipped
GPT-5.4 mini
2 of 4 flipped
Gemini 3.5 Flash
5 of 5 flipped
Perplexity Sonar
3 of 4 flipped
Grok 4.20
3 of 4 flipped
Mistral Small
3 of 4 flipped
DeepSeek V4 Flash
4 of 5 flipped
Llama 4 Maverick
4 of 4 flipped
Qwen 3.7 Flash
5 of 5 flipped
Kimi K2
4 of 5 flipped
GLM 4.7 FlashX
4 of 4 flipped
MiniMax M2.5
2 of 4 flipped
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Firebase read as Firebase Authentication
ForgeRock read as ForgeRock Identity Platform
ForgeRock (now Ping) read as ForgeRock Identity Platform
Supabase read as Supabase Auth
WorkOS read as WorkOS AuthKit
WorkOS (AuthKit) read as WorkOS AuthKit
Unresolved, counted raw
1Kosmos BlockID
BetterAuth
CA Siteminder
Duende
IDnow.io
Revolut (fintech-linked identity tools)
Discontinued, still offered
No shut-down product was recommended here.