Experimentation and personalization
Asked as “website experimentation and personalization platform”, and as “A/B testing and personalization tool”, on behalf of a mid-market B2B software company. 26 first choices recorded across the direct, paraphrase, budget and scale prompts, six models each.
Standing · first-choice share
42%
Clear leader
42VWO08AB Tasty08Convert Experiences42others
42% of first choices, clear leader.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all six models, for a mid-market B2B software company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
Show the six products at 0%, ordered by negative rate
11
Google Optimize Lab in the set0%70%10criticized challengernewNew since September 2026: not ranked then, 0% now.
Google Optimize Lab in the set0%70%10criticized challengernewNew since September 2026: not ranked then, 0% now.The floor is 12 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Google Optimize is made by Google, whose model Gemini 3.1 Pro is in the set. On the four share prompts that model made it the first choice zero times of 4; the other five models zero times of 20. Lab treatment is defined on the method page; the row is marked, not excluded.
All ten head-to-head pages: the top five products, each against each
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08
09
1011Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative60%
Key
01VWO42%
VWO42%02GrowthBook8%
GrowthBook8%03Convert Experiences8%
Convert Experiences8%04AB Tasty8%
AB Tasty8%05Optimizely CMS8%
Optimizely CMS8%06Statsig0%
Statsig0%07LaunchDarkly0%
LaunchDarkly0%08Kameleoon0%
Kameleoon0%09Dynamic Yield0%
Dynamic Yield0%10Adobe Target0%
Adobe Target0%11Google Optimize0%
Google Optimize0%What they warned about
Four of six models held their first choice under the paraphrase. Claude Opus 4.8 and Perplexity Sonar Pro changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Optimizely CMS54%
13 of 24 labels negative · 6 of 6 models · 1 hard negative
“What I'd rule out: Optimizely, unless you have unusual scale or budget” Claude Opus 5, paraphrase prompt
Google Optimize70%
7 of 10 labels negative · 5 of 6 models · 6 hard negative
“Google Optimize is the most famous cautionary tale — Google discontinued its free (and 360) A/B testing and personalization tool in September 2023” Claude Opus 4.8, negative prompt
AB Tasty27%
6 of 22 labels negative · 4 of 6 models
“VWO and AB Tasty: These two major competitors were merged by Everstone Capital in early 2026.” Gemini 3.1 Pro, negative prompt
Adobe Target40%
6 of 15 labels negative · 4 of 6 models
“usually capable but expensive, slow to implement, and only sensible if you're already committed to that stack” Claude Opus 5, negative prompt
What they cite
Six of the six models returned a source list in this edition: six return the pages they cited.
Sites the answers cite
32 of 36 answers in this category came back with a source list, from 6 of 6 models: citations where the model returns them, or the search results it consulted. 541 links across 235 sites, every framing counted. Ranked by the number of answers carrying the site or page. None of the 36 answers across every segment cited this index's own page for the category.
vendor site · VWO19 answers · 28 citations · 5 models
vendor site · Convert15 answers · 22 citations · 6 models
vendor site · GrowthBook14 answers · 24 citations · 6 models
vendor site · Statsig12 answers · 24 citations · 6 models
vendor site · Amplitude10 answers · 12 citations · 5 models
10 answers · 11 citations · 3 models
vendor site · Mida9 answers · 11 citations · 3 models
vendor site · Optimizely8 answers · 9 citations · 5 models
7 answers · 8 citations · 4 models
vendor site · Guideflow7 answers · 8 citations · 3 models
7 answers · 7 citations · 3 models
vendor site · Gartner7 answers · 7 citations · 3 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
9 answers · 3 models
7 answers · 3 models
7 answers · 3 models
7 answers · 3 models
6 answers · 3 models
6 answers · 3 models
6 answers · 3 models
5 answers · 3 models
5 answers · 3 models
5 answers · 3 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best website experimentation and personalization platform”, “website experimentation and personalization platform”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| VWO vwo.com | 42% | 147 | 22,200 | 449 | 25,874 | 14 | 5 | |
| GrowthBook growthbook.io | 8% | 87 | 2,900 | 14 | 26,646 | 26 | ||
| Convertize convert.com Convert Experiences 8%, Convertize 0% | 8% | 79 | 50 | 22 | 20,882 | 1 | ||
| PostHog posthog.com | 8% | 420 | 33,100 | 271 | 25,936 | 120 | ||
| AB Tasty abtasty.com | 8% | 74 | 1,000 | 27 | 23,529 | 3 | ||
| Mutiny mutinyhq.com | 8% | 69 | 110,000 | 3,032 | 680 | 0 | ||
| Zoho parent site Zoho PageSense 8% | 8% | 40 | 260 | 6 | ||||
| Optimizely optimizely.com Optimizely CMS 8% | 8% | 229 | 60,500 | 36,211 | 200,757 company | $2 | 120 | 3 |
| Varify.io varify.io | 4% | 11 | ||||||
| Statsig statsig.com | 0% | 67 | 12,100 | 182 | 353,837 | $176 | 6 |
Google's top ten for the two searches hold 17 sites; 5 of them are among the sites the models cited here (gartner.com, guideflow.com, mida.so, optimizely.com, vwo.com). The first result for “best website experimentation and personalization platform” is gartner.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best website experimentation and personalization platform for a mid-market B2B software company?”Paraphrase“Which A/B testing and personalization tool would you recommend to a mid-sized B2B software company?”Comparative“What are the top experimentation and personalization platforms and how do they differ?”Budget-constrained“What is the best website experimentation and personalization platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a website experimentation and personalization platform. What should we look at?”Negative“Which experimentation and personalization platforms should I avoid or be cautious about?”
Claude Opus 5VWOagainst: Adobe Target, Optimizely CMSVWOHeldagainst: AB Tasty, Optimizely CMS, Statsig, Webflow Optimizeno first choiceagainst: Adobe Target, ConfigCat, Dynamic Yield, Flagsmith, Google Optimize, Optimizely CMS, UnleashGrowthBook, PostHogagainst: Convert Experiencesno first choiceagainst: Optimizely CMSagainst: Acquia Personalization, Adobe Target, Dynamic Yield, Eppo, Fibr, Google Optimize, Intellimize, Keak, Mida, Monetate, Optimizely CMS, Qubit, Salesforce Marketing Cloud Personalization, Sigmize, Sitecore Personalize, Split, Statsig
Seven alternatives
AB Tasty, GrowthBook, Kameleoon, Mutiny, PostHog, Statsig, Webflow OptimizeThree alternatives
GrowthBook, Mutiny, PostHogNine alternatives
AB Tasty, Convert Experiences, Eppo, GrowthBook, Kameleoon, LaunchDarkly, PostHog, Statsig, VWOThree alternatives
OptiMonk, Statsig, VWOFour alternatives
Convert Experiences, Kameleoon, VWO, Webtrends OptimizeClaude Opus 4.8AB Tasty, VWOagainst: Optimizely CMSVWOChangedLaunchDarkly, VWOVWOno first choiceagainst: Google Optimize, Meta, Mutiny
Two alternatives
Mutiny, StatsigTwo alternatives
Kameleoon, Optimizely CMSNine alternatives
AB Tasty, Adobe Target, Bloomreach, Dynamic Yield, Eppo, GrowthBook, Optimizely CMS, Split, StatsigThree alternatives
Convert Experiences, Convertize, Zoho PageSenseGPT-6 AstraVWOagainst: MutinyVWOHeldAB Tasty, Statsig, VWOZoho PageSenseAB Tasty, Optimizely CMS, VWOagainst: AB Tasty, Adobe Target, Dynamic Yield, Google Optimize, Optimizely CMS
Two alternatives
Convert Experiences, Webflow OptimizeOne alternative
Webflow OptimizeEight alternatives
Adobe Target, Amplitude Experiment, Dynamic Yield, Eppo, GrowthBook, LaunchDarkly, Optimizely CMS, Salesforce Marketing Cloud PersonalizationOne alternative
GrowthBookThree alternatives
Adobe Target, Dynamic Yield, GrowthBookGPT-5.6 SolVWOagainst: Optimizely CMSVWOHeldagainst: Optimizely CMSOptimizely CMSZoho PageSenseagainst: AB Tasty, Optimizely CMS, VWOno first choiceagainst: AB Tasty, Adobe Target, Google Optimize, LaunchDarkly Experimentation, Optimizely Web Experimentation, Salesforce Marketing Cloud Personalization, VWO Web Testing
Three alternatives
Convert Experiences, Kameleoon, MutinyThree alternatives
LaunchDarkly, Mutiny, StatsigNine alternatives
Adobe Target, Amplitude Experiment, Datadog Experiments, formerly centered on Eppo, Dynamic Yield, GrowthBook, Kameleoon, LaunchDarkly, Statsig, Wingify — VWO + AB TastyTwo alternatives
GrowthBook, PostHogGemini 3.1 ProMutinyagainst: Optimizely CMSMutinyHeldOptimizely CMSagainst: Adobe TargetGrowthBook, PostHogagainst: AB Tasty, Optimizely CMS, VWOOptimizely CMSagainst: AB Tasty, Eppo, Flagd, Google Optimize, Instapage, LaunchDarkly, Monetate, Oracle Maxymiser, SiteSpect, Statsig, Unbounce, VWO
Three alternatives
Convert Experiences, PostHog, VWOFour alternatives
Convert Experiences, PostHog, Statsig, VWOTen alternatives
AB Tasty, Bloomreach, CleverTap, Dynamic Yield, Insider, Kameleoon, LaunchDarkly, SAP Emarsys, Statsig, VWOTwo alternatives
Convert Experiences, Crazy EggSeven alternatives
AB Tasty, Dynamic Yield, Kameleoon, LaunchDarkly, Monetate, Statsig, VWOPerplexity Sonar ProConvert Experiences, VWOagainst: Optimizely CMSConvert ExperiencesChangedStatsigVarify.ioagainst: VWOno first choicenothing named
Two alternatives
AB Tasty, StatsigThree alternatives
Eppo, LaunchDarkly, VWOSix alternatives
Adobe Target, Eppo, GrowthBook, LaunchDarkly, Optimizely CMS, VWOThree alternatives
Mida, Statsig, Zoho PageSenseBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Thirty-six rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Opus 5 | claude-opus-5 | 2026-09-09 14:34 | yes | 21 | 63 s |
| Direct recommendation | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-09 14:35 | yes | 23 | 41 s |
| Direct recommendation | GPT-6 Astra | gpt-6-astra | 2026-09-09 14:37 | yes | 7 | 37 s |
| Direct recommendation | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-09 14:38 | yes | 6 | 58 s |
| Direct recommendation | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-09 14:36 | yes | 16 | 45 s |
| Direct recommendation | Perplexity Sonar Pro | sonar-pro | 2026-09-09 14:35 | yes | 20 | 9 s |
| Paraphrase | Claude Opus 5 | claude-opus-5 | 2026-09-09 14:39 | yes | 37 | 76 s |
| Paraphrase | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-09 14:40 | no | 0 | 20 s |
| Paraphrase | GPT-6 Astra | gpt-6-astra | 2026-09-09 14:41 | yes | 4 | 33 s |
| Paraphrase | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-09 14:42 | yes | 3 | 42 s |
| Paraphrase | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-09 14:40 | no | 0 | 30 s |
| Paraphrase | Perplexity Sonar Pro | sonar-pro | 2026-09-09 14:40 | yes | 20 | 6 s |
| Comparative | Claude Opus 5 | claude-opus-5 | 2026-09-09 14:43 | yes | 22 | 80 s |
| Comparative | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-09 14:49 | yes | 19 | 313 s |
| Comparative | GPT-6 Astra | gpt-6-astra | 2026-09-09 14:51 | yes | 13 | 53 s |
| Comparative | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-09 14:52 | yes | 10 | 76 s |
| Comparative | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-09 14:50 | yes | 9 | 45 s |
| Comparative | Perplexity Sonar Pro | sonar-pro | 2026-09-09 14:49 | yes | 20 | 10 s |
| Budget constrained | Claude Opus 5 | claude-opus-5 | 2026-09-09 14:54 | yes | 35 | 71 s |
| Budget constrained | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-09 14:55 | yes | 17 | 61 s |
| Budget constrained | GPT-6 Astra | gpt-6-astra | 2026-09-09 14:56 | yes | 4 | 19 s |
| Budget constrained | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-09 14:57 | yes | 4 | 25 s |
| Budget constrained | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-09 14:56 | yes | 21 | 60 s |
| Budget constrained | Perplexity Sonar Pro | sonar-pro | 2026-09-09 14:55 | yes | 20 | 7 s |
| Scale constrained | Claude Opus 5 | claude-opus-5 | 2026-09-09 14:59 | yes | 31 | 127 s |
| Scale constrained | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-09 15:00 | no | 0 | 24 s |
| Scale constrained | GPT-6 Astra | gpt-6-astra | 2026-09-09 15:01 | yes | 8 | 51 s |
| Scale constrained | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-09 15:03 | yes | 5 | 84 s |
| Scale constrained | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-09 15:00 | no | 0 | 27 s |
| Scale constrained | Perplexity Sonar Pro | sonar-pro | 2026-09-09 15:00 | yes | 20 | 9 s |
| Negative framing | Claude Opus 5 | claude-opus-5 | 2026-09-09 15:05 | yes | 44 | 105 s |
| Negative framing | Claude Opus 4.8 | claude-opus-4-8 | 2026-09-09 15:06 | yes | 40 | 60 s |
| Negative framing | GPT-6 Astra | gpt-6-astra | 2026-09-09 15:08 | yes | 5 | 32 s |
| Negative framing | GPT-5.6 Sol | gpt-5.6-sol | 2026-09-09 15:10 | yes | 9 | 112 s |
| Negative framing | Gemini 3.1 Pro | gemini-3.1-pro-preview | 2026-09-09 15:07 | yes | 10 | 41 s |
| Negative framing | Perplexity Sonar Pro | sonar-pro | 2026-09-09 15:06 | yes | 18 | 9 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Acquia read as Acquia Personalization
Convert read as Convert Experiences
Convert.com read as Convert Experiences
Google read as Google Optimize
Salesforce Personalization read as Salesforce Marketing Cloud Personalization
Unresolved, counted raw
Meta
Discontinued, still offered
No shut-down product was recommended here.