Contract lifecycle management and e-signature for enterprise buyers
Asked as “contract lifecycle management platform”, and as “e-signature and contract management tool”, on behalf of an enterprise B2B company. 40 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
22%
Contested · DocuSign 20%
22Ironclad20DocuSign12Sirion45others
22% of first choices, contested.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
Show the three products at 0%, ordered by negative rate
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Head to headHead-to-head pages are published for mid-market buyers, so these open on mid-market figures, not enterprise.
All twenty-eight head-to-head pages: the top eight products, each against each
PandaDoc vs SpotDraftPandaDoc vs LinkSquaresPandaDoc vs GetAcceptPandaDoc vs ContractWorksJuro vs IroncladJuro vs ConcordJuro vs SpotDraftJuro vs LinkSquaresJuro vs GetAcceptJuro vs ContractWorksIronclad vs ConcordIronclad vs SpotDraftIronclad vs LinkSquaresIronclad vs GetAcceptIronclad vs ContractWorksConcord vs SpotDraftConcord vs LinkSquaresConcord vs GetAcceptConcord vs ContractWorksSpotDraft vs LinkSquaresSpotDraft vs GetAcceptSpotDraft vs ContractWorksLinkSquares vs GetAcceptLinkSquares vs ContractWorksGetAccept vs ContractWorks
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07S08
09Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative40%
Key
01Ironclad22%
Ironclad22%02Sirion12%
Sirion12%03Icertis Contract Intelligence10%
Icertis Contract Intelligence10%04Agiloft Contract Management Suite10%
Agiloft Contract Management Suite10%05DocuSign CLM8%
DocuSign CLM8%06Juro2%
Juro2%07Conga CLM0%
Conga CLM0%08SAP Ariba Contracts0%
09LinkSquares0%
LinkSquares0%What they warned about
Zero of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.20, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Ironclad26%
14 of 54 labels negative · 8 of 12 models · 2 hard negative
“What to avoid at your scale - Per-seat-first vendors (Ironclad, DocuSign CLM, Conga):” DeepSeek V4 Flash, budget prompt
Conga CLM24%
9 of 37 labels negative · 8 of 12 models · 1 hard negative
“What to avoid at your scale - Per-seat-first vendors (Ironclad, DocuSign CLM, Conga):” DeepSeek V4 Flash, budget prompt
DocuSign CLM33%
14 of 43 labels negative · 8 of 12 models · 1 hard negative
“What to avoid at your scale ... DocuSign CLM runs $200K–$500K+ above 100 users” DeepSeek V4 Flash, budget prompt
Icertis Contract Intelligence19%
9 of 48 labels negative · 7 of 12 models · 2 hard negative
“the most expensive ... the least friendly for wide, cost-predictable rollouts” DeepSeek V4 Flash, budget prompt
What they cite
Four of the twelve models returned a source list in this edition: four return the pages they cited.
Sites the answers cite
22 of 72 answers in this category came back with a source list, from 4 of 12 models: citations where the model returns them, or the search results it consulted. 308 links across 113 sites, every framing counted. Ranked by the number of answers carrying the site or page. The other 8 models searched through a gateway that returned no source list on this edition.
vendor site · Sirion16 answers · 31 citations · 3 models
10 answers · 11 citations · 4 models
vendor site · Gartner8 answers · 18 citations · 4 models
vendor site · Bind8 answers · 12 citations · 2 models
vendor site · GetAccept8 answers · 9 citations · 3 models
vendor site · DocuSign7 answers · 8 citations · 3 models
vendor site · Conga6 answers · 6 citations · 3 models
vendor site · ContractSafe5 answers · 10 citations · 3 models
vendor site · Aline5 answers · 6 citations · 2 models
vendor site · CobbleStone Software5 answers · 6 citations · 3 models
5 answers · 6 citations · 2 models
vendor site · Juro5 answers · 5 citations · 2 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
8 answers · 3 models
7 answers · 2 models
6 answers · 3 models
5 answers · 3 models
5 answers · 2 models
5 answers · 4 models
5 answers · 2 models
5 answers · 3 models
5 answers · 3 models
5 answers · 2 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best contract lifecycle management platform”, “contract lifecycle management platform”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| DocuSign docusign.com DocuSign 20%, DocuSign CLM 8%, DocuSign IAM 2% | 30% | 104 | 1,000,000 | 9,641 | 2,280,470 | $20 | 120 | |
| Ironclad ironcladapp.com | 22% | 137 | 49,500 | 3,365 | 128,319 | 120 | ||
| Sirion sirion.ai Sirion 12%, SirionLabs 0% | 12% | 66 | 1,600 | 99 | 302,031 | $1,680 | 28 | |
| Icertis Contract Intelligence icertis.com | 10% | 102 | 140 | 2 | 173,589 | 29 | ||
| Agiloft Contract Management Suite agiloft.com | 10% | 111 | 12,773 | $23,523 | 17 | 2 | ||
| ContractSafe contractsafe.com | 10% | 59 | 1,000 | 7 | 38,687 | $687 | 120 | |
| Juro juro.com | 2% | 63 | 2,900 | 536 | 44,442 | $168 | 120 | |
| Gatekeeper gatekeeperhq.com | 2% | 13 | 40,500 | 3,731 | 69,315 | $83,492 | 20 | |
| Conga CLM conga.com | 0% | 68 | 480 | 11 | 46,363 | $224 | 120 | |
| SAP Ariba Contracts | 0% | 135,000 | 74,309 |
Google's top ten for the two searches hold 17 sites; 1 of them are among the sites the models cited here (aline.co). The first result for “best contract lifecycle management platform” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best contract lifecycle management platform for an enterprise B2B company?”Paraphrase“Which e-signature and contract management tool would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade contract lifecycle management platforms and how do they differ?”Budget-constrained“What is the best contract lifecycle management platform for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a contract lifecycle management platform. What should we look at?”Negative“Which contract lifecycle management platforms should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5IroncladDocuSignChangedno first choiceAgiloft Contract Management Suiteno first choiceagainst: Agiloft Contract Management Suite, DocuSign CLM, Icertis Contract Intelligence
Three alternatives
Agiloft Contract Management Suite, LinkSquares, SAP Ariba ContractsOne alternative
Adobe Acrobat SignTwo alternatives
DocuSign CLM, IroncladGPT-5.4 miniDocuSign CLM, Icertis Contract IntelligenceDocuSignChangedIcertis Contract IntelligenceIcertis Contract Intelligenceagainst: Ironcladno first choiceagainst: Agiloft Contract Management Suite, JAGGAER Contract Management, Juro, SAP Contract Lifecycle Management, SpotDraft
Three alternatives
Conga CLM, Ironclad, SirionTwo alternatives
Adobe Acrobat Sign, PandaDocNine alternatives
Conga CLM, Coupa CLM, DocuSign CLM, Ironclad, Ivalua, JAGGAER, SAP Ariba Contracts, SAP CLM, SirionGemini 3.5 FlashIroncladDocuSign, IroncladChangedIroncladGatekeeperagainst: Ironclad, Sirionno first choiceagainst: Concord, Conga CLM, GEP, Gatekeeper, Icertis Contract Intelligence, Ironclad, JAGGAER, LinkSquares
Five alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Icertis Contract Intelligence, SirionTwo alternatives
Agiloft Contract Management Suite, Icertis Contract IntelligenceSix alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Icertis Contract Intelligence, Sirion, Workday CLMThree alternatives
CobbleStone Software, Concord, ContractSafePerplexity SonarSirionDocuSign CLMChangedIcertis Contract IntelligenceIroncladagainst: DocuSign CLMno first choiceagainst: CobbleStone Software, Conga CLM, ContractWorks, Contractbook, DocuSign CLM, Juro, LinkSquares, Malbek, Oneflow, PandaDoc
Three alternatives
Conga CLM, Icertis Contract Intelligence, IroncladTwo alternatives
Icertis Contract Intelligence, IroncladSix alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Ironclad, SAP Ariba Contracts, SirionTwo alternatives
Conga CLM, Icertis Contract IntelligenceGrok 4.20IroncladDocuSignChangedIroncladagainst: SAP Ariba ContractsAgiloft Contract Management Suiteagainst: ContractSafe, ContractWorks, DocuSign CLM, Icertis Contract Intelligence, Juro, Sirionno first choiceagainst: Conga CLM, DocuSign CLM, Ironclad
Three alternatives
Conga CLM, DocuSign CLM, SirionFour alternatives
Conga CLM, Icertis Contract Intelligence, Ironclad, SirionFive alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Icertis Contract Intelligence, SirionOne alternative
IroncladTwo alternatives
Ironclad, SirionMistral SmallSirionDocuSign CLMChangedIcertis Contract IntelligenceContractSafeno first choiceagainst: Conga CLM, Coupa CLM, Gatekeeper, HyperStart, Sirion, Workday CLM
Five alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Icertis Contract Intelligence, IroncladTwo alternatives
Icertis Contract Intelligence, IroncladSeven alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Ironclad, LinkSquares, SAP Ariba Contracts, SirionTwo alternatives
Agiloft Contract Management Suite, IroncladDeepSeek V4 FlashIroncladDocuSign IAMChangedagainst: Dropbox Signno first choiceagainst: IroncladAgiloft Contract Management Suiteagainst: Conga CLM, ContractSafe, ContractWorks, DocuSign CLM, Icertis Contract Intelligence, Ironcladno first choiceagainst: DocuSign CLM, Ironcladagainst: Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Icertis Contract Intelligence, Ironclad
Two alternatives
Icertis Contract Intelligence, SirionFour alternatives
Adobe Acrobat Sign, Conga CLM, Icertis Contract Intelligence, IroncladSix alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Icertis Contract Intelligence, SAP Ariba Contracts, SirionOne alternative
SirionTwo alternatives
Icertis Contract Intelligence, SirionLlama 4 Maverickno first choiceDocuSignChangedno first choiceno first choiceno first choicenothing named
Two alternatives
GetAccept, SirionQwen 3.7 FlashIroncladagainst: Salesforce CPQDocuSignChangedno first choiceContractSafeagainst: DocuSign CLM, Ironclad, PandaDoc, Zoho Contractsno first choiceagainst: BambooHR, Clio, Conga CLM, DocuSign, Ivalua, Microsoft Power Apps / SharePoint Solutions, Oracle OTOH, PandaDoc, SAP GRC, Salesforce Custom Objects, Upland Qvidian, Verint, Worldox
Two alternatives
Conga CLM, DocuSign CLMTwo alternatives
LinkSquares, Salesforce ContractsFive alternatives
Agiloft Contract Management Suite, DocuSign CLM, Icertis Contract Intelligence, Ironclad, SirionOne alternative
JuroKimi K2Icertis Contract Intelligence, SirionIroncladChangedagainst: DocuSign CLMIcertis Contract IntelligenceContractSafeagainst: Icertis Contract Intelligence, Ironclad, SirionIroncladagainst: Agiloft Contract Management Suite, Apttus, Conga CLM, ContractPodAi, DocuSign CLM, Exari, Gatekeeper, Icertis Contract Intelligence, Ironclad, Juro, Sirion, Summize
Four alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, IroncladOne alternative
Icertis Contract IntelligenceEight alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Ironclad, Leah, LinkSquares, SAP Ariba Contracts, SirionTwo alternatives
Agiloft Contract Management Suite, ContractWorksFour alternatives
Agiloft Contract Management Suite, DocuSign CLM, Icertis Contract Intelligence, SirionGLM 4.7 FlashXSirionDocuSignChangedIcertis Contract IntelligenceContractSafeagainst: Concord, Icertis Contract Intelligence, Ironclad, Juro, PandaDocno first choiceagainst: Conga CLM, DocuSign CLM, Ironclad, LinkSquares, SAP Ariba Contracts, Salesforce Revenue Cloud, SharePoint-based CLM builds, Sirion CLM, SpotDraft, Workday Strategic Sourcing
Four alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, IroncladOne alternative
IroncladSeven alternatives
Agiloft Contract Management Suite, Conga CLM, ContractPodAi, DocuSign CLM, Ironclad, SAP Ariba Contracts, SirionOne alternative
ContractWorksMiniMax M2.5Icertis Contract Intelligence, SirionDocuSignChangedno first choiceAgiloft Contract Management Suite, Juroagainst: ContractSafe, DocuSign CLM, Icertis Contract Intelligence, Ironclad, SAP Ariba Contractsno first choiceagainst: DocuSign CLM, Gatekeeper, LinkSquares
Four alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, IroncladFour alternatives
Adobe Acrobat Sign, Agiloft Contract Management Suite, Icertis Contract Intelligence, SirionLabsSix alternatives
Agiloft Contract Management Suite, Conga CLM, DocuSign CLM, Icertis Contract Intelligence, Ironclad, SirionBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Seventy-two rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 00:02 | yes | 7 | 13 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-14 23:49 | yes | 4 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-14 23:54 | yes | 17 | 26 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-09-15 00:47 | yes | 20 | 6 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 02:30 | yes | 0 | 7 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 00:01 | yes | 0 | 12 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-15 04:42 | yes | 0 | 17 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 00:59 | yes | 0 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-15 04:13 | no | 0 | 33 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-14 23:01 | yes | 0 | 45 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 02:19 | yes | 0 | 39 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 01:52 | yes | 0 | 25 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 04:48 | yes | 11 | 10 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-14 23:36 | yes | 2 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 00:51 | yes | 10 | 20 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-09-15 03:43 | yes | 18 | 6 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 01:07 | yes | 0 | 7 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 04:34 | yes | 0 | 7 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-15 04:47 | yes | 0 | 17 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 02:10 | yes | 0 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-14 23:37 | yes | 0 | 18 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-15 03:30 | yes | 0 | 28 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-14 23:06 | yes | 0 | 26 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 00:04 | yes | 0 | 26 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 03:54 | yes | 12 | 12 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 03:56 | yes | 8 | 10 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 03:00 | yes | 17 | 30 s |
| Comparative | Perplexity Sonar | sonar | 2026-09-14 23:28 | yes | 20 | 20 s |
| Comparative | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 01:46 | yes | 0 | 9 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 01:49 | yes | 0 | 8 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-15 04:06 | yes | 0 | 25 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 01:20 | yes | 0 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-15 03:55 | yes | 0 | 29 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-14 23:09 | yes | 0 | 50 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 00:43 | yes | 0 | 161 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 01:44 | yes | 0 | 12 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 00:19 | yes | 18 | 12 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 02:21 | yes | 3 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 04:01 | yes | 26 | 29 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-09-14 22:59 | yes | 20 | 7 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-14 23:32 | yes | 0 | 11 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 03:40 | yes | 0 | 11 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-15 01:08 | yes | 0 | 34 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 00:41 | yes | 0 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-15 01:36 | yes | 0 | 77 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-15 02:26 | yes | 0 | 32 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 03:13 | yes | 0 | 48 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 01:21 | yes | 0 | 81 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 02:05 | yes | 16 | 14 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 00:55 | no | 0 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 00:58 | no | 0 | 15 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-09-15 04:55 | yes | 17 | 8 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-14 23:48 | yes | 0 | 9 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-09-14 22:51 | no | 0 | 9 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-09-15 00:08 | yes | 0 | 59 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-15 02:58 | yes | 0 | 1 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-14 23:42 | no | 0 | 35 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-15 03:42 | yes | 0 | 84 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 02:10 | yes | 0 | 106 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 02:32 | yes | 0 | 20 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-09-15 04:33 | yes | 15 | 9 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-09-15 04:23 | yes | 6 | 8 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-09-15 02:21 | yes | 21 | 33 s |
| Negative framing | Perplexity Sonar | sonar | 2026-09-15 00:57 | yes | 20 | 7 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.1-fast-non-reasoning via vertex (asked for grok-4.20-non-reasoning; the API answered as this version) | 2026-09-15 01:17 | yes | 0 | 9 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-09-15 05:07 | yes | 0 | 13 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via fireworks | 2026-09-15 01:57 | yes | 0 | 31 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-09-14 23:20 | yes | 0 | 1 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-09-14 23:10 | no | 0 | 38 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-09-15 01:59 | yes | 0 | 68 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-09-15 03:50 | yes | 0 | 63 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-09-15 03:13 | yes | 0 | 47 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Agiloft read as Agiloft Contract Management Suite
CobbleStone read as CobbleStone Software
Conga read as Conga CLM
Conga (by DocuSign) read as Conga CLM
Conga (formerly Apttus) read as Conga CLM
Coupa read as Coupa CLM
Icertis read as Icertis Contract Intelligence
SAP Ariba read as SAP Ariba Contracts
SAP Ariba CLM read as SAP Ariba Contracts
Zoho read as Zoho Contracts
Unresolved, counted raw
Clio
DocuSign IAM (Intelligent Agreement Management)
Exari (now Coupa CLM)
Fujitsu CLM
JAGGAER Contract Management
Microsoft Power Apps / SharePoint Solutions
Oracle OTOH (Oracle Transactional OpenHub / Siebel Contracts)
SAP Contract Lifecycle Management (On-Premise)
SAP GRC
Salesforce Contracts
Salesforce Custom Objects
SharePoint-based CLM builds (PowerAutomate/PowerApps)
Spring CM
Workday Strategic Sourcing
Worldox
Discontinued, still offered
No shut-down product was recommended here.