Experimentation and personalization
Asked as “website experimentation and personalization platform”, and as “A/B testing and personalization tool”, on behalf of a mid-market B2B company. 61 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
31%
Contested · Convert Experiences 16%
31VWO16Convert Experiences08GrowthBook44others
31% of first choices, contested.
Since October 2026▲+4Since October 2026: 27% → 31%, +4 points. Inside the 11-point floor: within noise.VWO held the lead, +4 points on 27%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
VWO28%Contested▼−8Since October 2026: 36% → 28%, −8 points. Inside the 11-point floor: within noise.Standing →Mid-marketVWO31%Contested▲+4Since October 2026: 27% → 31%, +4 points. Inside the 11-point floor: within noise.This pageEnterprise
Optimizely CMS48%Clear leader▲+2Since October 2026: 46% → 48%, +2 points. Inside the 11-point floor: within noise.Standing →
VWO28%Contested▼−8Since October 2026: 36% → 28%, −8 points. Inside the 11-point floor: within noise.Standing →Mid-marketVWO31%Contested▲+4Since October 2026: 27% → 31%, +4 points. Inside the 11-point floor: within noise.This pageEnterpriseOptimizely CMS48%Clear leader▲+2Since October 2026: 46% → 48%, +2 points. Inside the 11-point floor: within noise.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01VWO31%14%65endorsed leader▲+4Since October 2026: 27% → 31%, +4 points. Inside the 11-point floor: within noise.27% → 31%
VWO31%14%65endorsed leader▲+4Since October 2026: 27% → 31%, +4 points. Inside the 11-point floor: within noise.27% → 31%02
Convert Experiences16%5%41accepted challenger▼−8Since October 2026: 24% → 16%, −8 points. Inside the 11-point floor: within noise.24% → 16%
Convert Experiences16%5%41accepted challenger▼−8Since October 2026: 24% → 16%, −8 points. Inside the 11-point floor: within noise.24% → 16%03
GrowthBook8%0%24accepted challenger▼−7Since October 2026: 15% → 8%, −7 points. Inside the 11-point floor: within noise.15% → 8%
GrowthBook8%0%24accepted challenger▼−7Since October 2026: 15% → 8%, −7 points. Inside the 11-point floor: within noise.15% → 8%04
Personyze5%0%18accepted challenger▲+3Since October 2026: 2% → 5%, +3 points. Inside the 11-point floor: within noise.2% → 5%
Personyze5%0%18accepted challenger▲+3Since October 2026: 2% → 5%, +3 points. Inside the 11-point floor: within noise.2% → 5%05Optimizely CMS5%46%61criticized challenger▼−2Since October 2026: 7% → 5%, −2 points. Inside the 11-point floor: within noise.7% → 5%
Optimizely CMS5%46%61criticized challenger▼−2Since October 2026: 7% → 5%, −2 points. Inside the 11-point floor: within noise.7% → 5%06
PostHog3%0%21accepted challenger▼−1Since October 2026: 4% → 3%, −1 point. Inside the 11-point floor: within noise.4% → 3%
PostHog3%0%21accepted challenger▼−1Since October 2026: 4% → 3%, −1 point. Inside the 11-point floor: within noise.4% → 3%07
AB Tasty2%17%30accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%
AB Tasty2%17%30accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%08
Mutiny2%31%16criticized challenger▼−5Since October 2026: 7% → 2%, −5 points. Inside the 11-point floor: within noise.7% → 2%
Mutiny2%31%16criticized challenger▼−5Since October 2026: 7% → 2%, −5 points. Inside the 11-point floor: within noise.7% → 2%Show the six products at 0%, ordered by negative rate
14
Google Optimize Lab in the set0%69%13criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Google Optimize Lab in the set0%69%13criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%13
Adobe Target0%50%40criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Adobe Target0%50%40criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%12
Dynamic Yield0%10%20accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Dynamic Yield0%10%20accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%09
Kameleoon0%9%32accepted challenger▼−4Since October 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise.4% → 0%
Kameleoon0%9%32accepted challenger▼−4Since October 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise.4% → 0%10
Statsig0%5%21accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Statsig0%5%21accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%11
LaunchDarkly0%0%17accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
LaunchDarkly0%0%17accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Google Optimize is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models zero times of 52. Lab treatment is defined on the method page; the row is marked, not excluded.
All twenty-eight head-to-head pages: the top eight products, each against each
VWO vs Optimizely CMSVWO vs PostHogVWO vs AB TastyVWO vs MutinyConvert Experiences vs GrowthBookConvert Experiences vs PersonyzeConvert Experiences vs Optimizely CMSConvert Experiences vs PostHogConvert Experiences vs AB TastyConvert Experiences vs MutinyGrowthBook vs PersonyzeGrowthBook vs Optimizely CMSGrowthBook vs PostHogGrowthBook vs AB TastyGrowthBook vs MutinyPersonyze vs Optimizely CMSPersonyze vs PostHogPersonyze vs AB TastyPersonyze vs MutinyOptimizely CMS vs PostHogOptimizely CMS vs AB TastyOptimizely CMS vs MutinyPostHog vs AB TastyPostHog vs MutinyAB Tasty vs Mutiny
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
0102030405060708091011121314Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01VWO31%
VWO31%02Convert Experiences16%
Convert Experiences16%03GrowthBook8%
GrowthBook8%04Personyze5%
Personyze5%05Optimizely CMS5%
Optimizely CMS5%06PostHog3%
PostHog3%07AB Tasty2%
AB Tasty2%08Mutiny2%
Mutiny2%09Kameleoon0%
Kameleoon0%10Statsig0%
Statsig0%11LaunchDarkly0%
LaunchDarkly0%12Dynamic Yield0%
Dynamic Yield0%13Adobe Target0%
Adobe Target0%14Google Optimize0%
Google Optimize0%What they warned about
Two of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.20, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Kimi K2, GLM 4.7 FlashX, MiniMax M2.5 and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Optimizely CMS46%
28 of 61 labels negative · 12 of 14 models · 6 hard negative
“you should exercise significant caution with Optimizely, particularly regarding its cost structure, support quality, and technical performance” Qwen 3.7 Flash, negative prompt
Adobe Target50%
20 of 40 labels negative · 10 of 14 models · 4 hard negative
“Avoid beginning with Optimizely, Adobe Target, Kameleoon, or AB Tasty” Perplexity Sonar, budget prompt
VWO14%
9 of 65 labels negative · 9 of 14 models · 2 hard negative
“Avoid VWO if page speed and user trust are critical, or if you have limited technical support.” GLM 4.7 FlashX, negative prompt
Google Optimize69%
9 of 13 labels negative · 5 of 14 models · 7 hard negative
“Why avoid: Google discontinued the product entirely. If you're still using it, you're running on unsupported infrastructure.” Kimi K2, negative prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
76 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 839 links across 250 sites, every framing counted. Ranked by the number of answers carrying the site or page. 28 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · Convert36 answers · 69 citations · 12 models
vendor site · Personyze29 answers · 34 citations · 10 models
vendor site · Croct26 answers · 36 citations · 11 models
vendor site · Optimizely23 answers · 31 citations · 12 models
vendor site · SMARTe17 answers · 17 citations · 9 models
vendor site · GrowthBook15 answers · 22 citations · 7 models
vendor site · Webflow15 answers · 15 citations · 8 models
vendor site · Mida14 answers · 14 citations · 10 models
13 answers · 28 citations · 6 models
vendor site · Wingify12 answers · 13 citations · 7 models
11 answers · 11 citations · 6 models
9 answers · 9 citations · 6 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
19 answers · 10 models
17 answers · 11 models
17 answers · 9 models
15 answers · 8 models
14 answers · 8 models
14 answers · 8 models
12 answers · 6 models
11 answers · 8 models
11 answers · 6 models
10 answers · 8 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best website experimentation and personalization platform”, “website experimentation and personalization platform”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| VWO vwo.com | 31% | 147 | 22,200 | 449 | 25,874 | 14 | 5 | |
| Convert Experiences convert.com | 16% | 79 | 50 | 22 | 20,882 | 1 | ||
| GrowthBook growthbook.io | 8% | 87 | 2,900 | 14 | 26,646 | 26 | ||
| OptiMonk optimonk.com | 7% | 16 | ||||||
| Zoho parent site Zoho PageSense 7% | 7% | 40 | 260 | 6 | ||||
| Personyze personyze.com | 5% | 47 | 50 | 1 | 536 | 0 | ||
| HubSpot parent site HubSpot Content Hub 5% | 5% | 318 | 368,000 | 9,776 | ||||
| Optimizely optimizely.com Optimizely CMS 5% | 5% | 229 | 60,500 | 36,211 | 200,757 company | $2 | 120 | 3 |
| PostHog posthog.com | 3% | 420 | 33,100 | 271 | 25,936 | 120 | ||
| Croct croct.com | 3% | 22 | 7 |
Google's top ten for the two searches hold 17 sites; 3 of them are among the sites the models cited here (blog.croct.com, mida.so, optimizely.com). The first result for “best website experimentation and personalization platform” is gartner.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best website experimentation and personalization platform for a mid-market B2B company?”Paraphrase“Which A/B testing and personalization tool would you recommend to a mid-sized B2B company?”Comparative“What are the top experimentation and personalization platforms and how do they differ?”Budget-constrained“What is the best website experimentation and personalization platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a website experimentation and personalization platform. What should we look at?”Negative“Which experimentation and personalization platforms should I avoid or be cautious about?”
Claude Haiku 4.5VWOagainst: Convert Experiences, Salesforce Marketing Cloud PersonalizationAB TastyChangedOptimizely CMSOptiMonk, Personizelyagainst: Optimizely CMSOptimizely CMS, VWOnothing named
Two alternatives
Mutiny, PersonyzeThree alternatives
Convert Experiences, Kameleoon, VWOSeven alternatives
AB Tasty, Autobound, CleverTap, Dynamic Yield, Kameleoon, Monetate, VWOTwo alternatives
Personyze, PostHogGPT-5.4 miniOptimizely CMSVWOChangedOptimizely CMSZoho PageSenseagainst: Optimizely CMSno first choicenothing named
Three alternatives
Adobe Target, Dynamic Yield, VWOThree alternatives
Adobe Target, Convert Experiences, Optimizely CMSThree alternatives
AB Tasty, Split, VWOOne alternative
Convert ExperiencesGemini 3.5 FlashVWOagainst: Adobe Target, Mutiny, Optimizely CMSMutinyChangedagainst: Optimizely CMSOptimizely CMSGrowthBookagainst: Optimizely CMS, VWOno first choiceagainst: Adobe Target, Coveo, Google Optimize, Monetate, Optimizely CMS, Qubit, Salesforce Marketing Cloud Personalization
Three alternatives
AB Tasty, HubSpot Marketing Hub, KameleoonThree alternatives
Convert Experiences, Kameleoon, VWONine alternatives
AB Tasty, Adobe Target, Dynamic Yield, GrowthBook, Harness, Kameleoon, LaunchDarkly, PostHog, VWOFive alternatives
Convert Experiences, ConvertFlow, Nelio A/B Testing, PostHog, StatsigPerplexity SonarHubSpot Content Hubagainst: Optimizely CMSConvert ExperiencesChangedOptimizely CMSCroctagainst: AB Tasty, Adobe Target, HubSpot Smart Content, Kameleoon, Optimizely CMSno first choiceagainst: Adobe Target, Dynamic Yield, Kameleoon, Mutiny, Ninetailed, Optimizely CMS
Five alternatives
Abmatic AI, Croct, Mutiny, VWO, Webflow OptimizeFive alternatives
AB Tasty, GrowthBook, Optimizely CMS, PostHog, VWOEleven alternatives
6sense, AB Tasty, Adobe Target, Bloomreach, Demandbase, Dynamic Yield, LaunchDarkly, Mutiny, Salesforce Marketing Cloud Personalization, Statsig, VWOFour alternatives
GrowthBook, Mida, OptiMonk, PostHogGrok 4.20Croctagainst: 6sense, Adobe Target, Demandbase, Optimizely CMSConvert ExperiencesChangedagainst: AB Tasty, ABsmartly, Adobe Target, Google OptimizeVWO, WingifyGrowthBook, PostHogagainst: Adobe Target, Google Optimize, Kameleoon, Optimizely CMSno first choiceagainst: Google Optimizeagainst: AB Tasty, Adobe Target, Optimizely CMS, VWO, Wingify
Three alternatives
AB Tasty, Kameleoon, VWOThree alternatives
Optimizely CMS, Personyze, VWOSeven alternatives
Adobe Target, Convert Experiences, GrowthBook, Optimizely CMS, Personyze, PostHog, StatsigThree alternatives
Convert Experiences, Crazy Egg, VWOMistral SmallHubSpot Content HubConvert Experiences, VWOChangedagainst: Optimizely CMSno first choiceOptiMonkno first choiceagainst: Adobe Target, Optimizely CMS, VWO
Three alternatives
Optimizely CMS, Personyze, VWOOne alternative
P PersonyzeThree alternatives
Croc, RightMessage, Varify.ioDeepSeek V4 FlashConvert Experiences, VWOConvert ExperiencesChangedagainst: AB Tasty, Adobe Target, Mutiny, Optimizely CMSno first choiceagainst: Adobe TargetZoho PageSenseConvert Experiences, VWOagainst: Adobe Targetagainst: Adobe Target, Optimizely CMS, VWO
Two alternatives
Mutiny, PersonyzeTwo alternatives
VWO, Varify.ioTen alternatives
AB Tasty, Bloomreach, Dynamic Yield, GrowthBook, Kameleoon, LaunchDarkly, Monetate, Optimizely CMS, Statsig, VWOTwo alternatives
GrowthBook, PostHogThree alternatives
Dynamic Yield, Kameleoon, Optimizely CMSLlama 4 MaverickHubSpot Content HubConvert Experiences, Personyze, VWOChangedno first choiceOptiMonkno first choiceagainst: Mutiny
Three alternatives
GrowthBook, PostHog, VWOQwen 3.7 FlashVWOagainst: Optimizely CMSVWOHeldno first choiceZoho PageSenseagainst: Optimizely CMSab t tastyagainst: Optimizely CMSagainst: Adobe Target, Optimizely CMS
Two alternatives
Convert Experiences, MutinyThree alternatives
Convert Experiences, Optimizely CMS, PostHogNine alternatives
Adobe Target, Dynamic Yield, Kameleoon, LaunchDarkly, Nosto, Optimizely CMS, PostHog, Statsig, VWOThree alternatives
GA4 Experiments, Microsoft Clarity, Visual Website OptimizerThree alternatives
Convert Experiences, Dynamic Yield, VWOKimi K2VWOagainst: Adobe Target, Dynamic Yield, Optimizely CMSConvert Experiences, VWOChangedagainst: Optimizely CMSOptimizely CMS, VWOagainst: Google OptimizeGrowthBook, PageDuelVWOagainst: Adobe Target, Optimizely CMSagainst: Adobe Experience Manager, Adobe Target, Google Optimize, Optimizely CMS, VWO
Two alternatives
Mutiny, PersonyzeOne alternative
MutinySeven alternatives
Adobe Target, Convert Experiences, Dynamic Yield, Kameleoon, LaunchDarkly, Monetate, SplitFour alternatives
Amplitude, Crazy Egg, PostHog, Varify.ioTwo alternatives
GrowthBook, KameleoonGLM 4.7 FlashXPersonyzeConvert ExperiencesChangedOptimizely CMS, VWOOptiMonk, Zoho PageSenseno first choiceagainst: AB Tasty, Adobe Target, Optimizely CMS, VWO
Four alternatives
HubSpot Content Hub, Optimizely CMS, Right Message, VWOTwo alternatives
Kameleoon, Varify.ioSix alternatives
AB Tasty, ABsmartly, Adobe Target, Convert Experiences, GrowthBook, StatsigFive alternatives
Crazy Egg, Croct, FigPii, Personizely, VWOMiniMax M2.5Personyzeagainst: Optimizely CMSOptimizely CMS, VWOChangedagainst: Google OptimizeOptimizely CMSGrowthBook, VWOno first choiceagainst: Adobe Target, Google Optimize, Optimizely CMS, VWO
Two alternatives
Convert Experiences, VWOTwo alternatives
HubSpot's Native A/B Testing, KameleoonEleven alternatives
AB Tasty, Adobe Target, Amplitude, Eppo, GrowthBook, Kameleoon, LaunchDarkly, Mutiny, PostHog, Statsig, VWOTwo alternatives
Convertize, PostHogGPT-6 LunaVWOagainst: MutinyVWOHeldAB Tasty, Optimizely CMS, VWOMidaagainst: VWOno first choiceagainst: Google Optimize, Gravy Analytics, Mobilewalla, Venntel
One alternative
AB TastyOne alternative
StatsigFour alternatives
Adobe Target, Dynamic Yield, LaunchDarkly, StatsigOne alternative
PostHogMuse Glimmer 30BVWOConvert Experiences, VWOChangedagainst: Adobe TargetOptimizely CMSGrowthBook, PostHogagainst: Convert Experiences, VWOno first choiceagainst: Optimizely CMS, Statsig
Four alternatives
Convert Experiences, Mutiny, Optimizely CMS, PersonyzeTwo alternatives
Optimizely CMS, PersonyzeFive alternatives
AB Tasty, Adobe Target, Kameleoon, LaunchDarkly, VWOTwo alternatives
OptiMonk, OptibaseBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:38 | yes | 10 | 7 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 12:12 | yes | 4 | 6 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 10:13 | yes | 6 | 23 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 08:51 | yes | 10 | 3 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:14 | yes | 11 | 14 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 08:47 | yes | 5 | 5 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 16:35 | yes | 9 | 18 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 10:56 | yes | 5 | 3 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 11:14 | yes | 5 | 22 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 15:43 | yes | 9 | 27 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 15:39 | yes | 25 | 30 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 12:12 | yes | 10 | 27 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 14:06 | yes | 3 | 22 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 16:10 | yes | 13 | 26 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 13:56 | yes | 17 | 9 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 08:43 | yes | 4 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 10:28 | no | 0 | 14 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 14:09 | yes | 10 | 4 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 14:30 | yes | 5 | 10 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 13:03 | yes | 5 | 7 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:00 | yes | 23 | 22 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 15:12 | yes | 5 | 3 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:13 | no | 0 | 29 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 11:43 | yes | 15 | 21 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:15 | yes | 20 | 40 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 08:41 | no | 0 | 14 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 13:52 | yes | 2 | 13 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 11:51 | yes | 13 | 21 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:59 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 17:14 | yes | 6 | 7 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 14:16 | yes | 7 | 22 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 15:27 | yes | 10 | 7 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 16:44 | yes | 5 | 14 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 15:39 | yes | 5 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 13:06 | yes | 25 | 47 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 09:20 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 11:23 | yes | 5 | 23 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 14:43 | yes | 25 | 48 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 12:12 | yes | 15 | 25 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 13:46 | yes | 10 | 29 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 14:48 | yes | 8 | 30 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 10:59 | yes | 20 | 24 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 15:47 | yes | 9 | 8 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 12:01 | yes | 3 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 12:07 | yes | 12 | 20 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 09:45 | yes | 10 | 4 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:11 | yes | 9 | 12 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 10:25 | yes | 5 | 5 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 15:31 | yes | 24 | 28 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 08:40 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:08 | yes | 5 | 30 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 10:18 | yes | 10 | 19 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 14:17 | yes | 15 | 18 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 12:36 | yes | 9 | 40 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 17:20 | yes | 3 | 18 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 08:48 | yes | 14 | 21 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 09:57 | yes | 9 | 10 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 11:00 | no | 0 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 09:58 | no | 0 | 19 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 09:22 | yes | 10 | 9 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 16:06 | yes | 5 | 15 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 14:07 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 14:04 | yes | 24 | 47 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 10:31 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 13:11 | no | 0 | 30 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 16:28 | yes | 25 | 36 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 10:20 | yes | 14 | 31 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 13:36 | yes | 5 | 36 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 17:19 | yes | 4 | 28 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 13:50 | yes | 14 | 27 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 14:26 | yes | 9 | 8 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 11:57 | yes | 4 | 7 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 16:49 | no | 0 | 22 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 16:14 | yes | 10 | 4 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:24 | yes | 20 | 18 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 16:29 | yes | 5 | 7 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 08:38 | yes | 24 | 26 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 15:02 | yes | 5 | 4 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 13:30 | yes | 15 | 31 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 10:27 | yes | 25 | 59 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 16:56 | yes | 24 | 71 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:25 | yes | 23 | 57 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 13:17 | yes | 3 | 18 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 17:33 | yes | 25 | 32 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Convert read as Convert Experiences
Convert.com read as Convert Experiences
Evergage read as Salesforce Marketing Cloud Personalization
HubSpot read as HubSpot Content Hub
Salesforce Personalization read as Salesforce Marketing Cloud Personalization
Unresolved, counted raw
Conductrics
Croc
CustomFit
Evolv AI
GA4 Experiments
Harness (includes Split.io)
HubSpot's Native A/B Testing
Neat A/B
Nelio A/B Testing
Omniconvert Explore
Optimizely Feature Experimentation
Optimizely SaaS CMS
Optimizely X
P Personyze
PageDuel
Right Message
SAP
Salesforce
Wingify formerly VWO
ab t tasty
Discontinued, still offered
No shut-down product was recommended here.