CI/CD platforms for enterprise buyers
Asked as “CI/CD platform”, and as “continuous integration and delivery tool”, on behalf of an enterprise B2B company. 56 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
54%
Clear leader
54GitLab CI/CD18GitHub Actions11Azure DevOps18others
54% of first choices, clear leader.
Since October 2026▲+12Since October 2026: 42% → 54%, +12 points. Past the 11-point floor: movement.GitLab CI/CD held the lead, +12 points on 42%, past the floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
GitHub Actions88%Clear leader▲+13Since October 2026: 75% → 88%, +13 points. Past the 11-point floor: movement.Standing →Mid-marketGitHub Actions70%Clear leader▲+2Since October 2026: 68% → 70%, +2 points. Inside the 11-point floor: within noise.Standing →Enterprise
GitLab CI/CD54%Clear leader▲+12Since October 2026: 42% → 54%, +12 points. Past the 11-point floor: movement.This page
GitHub Actions88%Clear leader▲+13Since October 2026: 75% → 88%, +13 points. Past the 11-point floor: movement.Standing →Mid-marketGitHub Actions70%Clear leader▲+2Since October 2026: 68% → 70%, +2 points. Inside the 11-point floor: within noise.Standing →EnterpriseGitLab CI/CD54%Clear leader▲+12Since October 2026: 42% → 54%, +12 points. Past the 11-point floor: movement.This pageThe standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01GitLab CI/CD54%5%81endorsed leader▲+12Since October 2026: 42% → 54%, +12 points. Past the 11-point floor: movement.42% → 54%
GitLab CI/CD54%5%81endorsed leader▲+12Since October 2026: 42% → 54%, +12 points. Past the 11-point floor: movement.42% → 54%02GitHub Actions18%27%67criticized challenger▼−1Since October 2026: 19% → 18%, −1 point. Inside the 11-point floor: within noise.19% → 18%
GitHub Actions18%27%67criticized challenger▼−1Since October 2026: 19% → 18%, −1 point. Inside the 11-point floor: within noise.19% → 18%03
Azure DevOps11%9%47accepted challenger=heldSince October 2026: 11% → 11%, ±0 points. Inside the 11-point floor: within noise.11% → 11%
Azure DevOps11%9%47accepted challenger=heldSince October 2026: 11% → 11%, ±0 points. Inside the 11-point floor: within noise.11% → 11%04
CircleCI5%35%54criticized challenger▲+5Since October 2026: 0% → 5%, +5 points. Inside the 11-point floor: within noise.0% → 5%
CircleCI5%35%54criticized challenger▲+5Since October 2026: 0% → 5%, +5 points. Inside the 11-point floor: within noise.0% → 5%05
GitHub4%15%13accepted challenger=heldSince October 2026: 4% → 4%, ±0 points. Inside the 11-point floor: within noise.4% → 4%
GitHub4%15%13accepted challenger=heldSince October 2026: 4% → 4%, ±0 points. Inside the 11-point floor: within noise.4% → 4%06
Buildkite2%8%24accepted challenger▼−9Since October 2026: 11% → 2%, −9 points. Inside the 11-point floor: within noise.11% → 2%
Buildkite2%8%24accepted challenger▼−9Since October 2026: 11% → 2%, −9 points. Inside the 11-point floor: within noise.11% → 2%07
Azure Pipelines2%5%19accepted challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%
Azure Pipelines2%5%19accepted challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%08
CloudBees CI2%19%16accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%
CloudBees CI2%19%16accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%09
Jenkins2%53%60criticized challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%
Jenkins2%53%60criticized challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%Show the three products at 0%, ordered by negative rate
12
JetBrains TeamCity0%20%15accepted challenger▼−4Since October 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise.4% → 0%
JetBrains TeamCity0%20%15accepted challenger▼−4Since October 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise.4% → 0%11
Argo CD0%19%16accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Argo CD0%19%16accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%10
Harness0%10%30accepted challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%
Harness0%10%30accepted challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Head to headHead-to-head pages are published for mid-market buyers, so these open on mid-market figures, not enterprise.
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
010203040506070809101112Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative70%
Key
01GitLab CI/CD54%
GitLab CI/CD54%02GitHub Actions18%
GitHub Actions18%03Azure DevOps11%
Azure DevOps11%04CircleCI5%
CircleCI5%05GitHub4%
GitHub4%06Buildkite2%
Buildkite2%07Azure Pipelines2%
Azure Pipelines2%08CloudBees CI2%
CloudBees CI2%09Jenkins2%
Jenkins2%10Harness0%
Harness0%11Argo CD0%
Argo CD0%12JetBrains TeamCity0%
JetBrains TeamCity0%What they warned about
Six of fourteen models held their first choice under the paraphrase. GPT-5.4 mini, Gemini 3.5 Flash, Mistral Small, Llama 4 Maverick, Kimi K2, GLM 4.7 FlashX, MiniMax M2.5 and GPT-6 Luna changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Jenkins53%
32 of 60 labels negative · 14 of 14 models · 6 hard negative
“here are the CI/CD platforms and approaches that large enterprises should approach with caution or avoid entirely: ## 1. Jenkins” GLM 4.7 FlashX, negative prompt
CircleCI35%
19 of 54 labels negative · 11 of 14 models · 4 hard negative
“What to Avoid for Predictable Costs | CircleCI | Credit-based, per-minute billing ... unpredictable at enterprise scale” DeepSeek V4 Flash, budget prompt
GitHub Actions27%
18 of 67 labels negative · 11 of 14 models · 2 hard negative
“What to Avoid for Predictable Costs ... Per-minute runner fees ($0.006/min+), plus the new platform fee adds metering uncertainty” DeepSeek V4 Flash, budget prompt
Travis CI100%
8 of 8 labels negative · 7 of 14 models · 7 hard negative
“Travis CI has faded from most 2026 shortlists. It also has notable performance and capability gaps for enterprise use.” Claude Haiku 4.5, negative prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
69 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 751 links across 220 sites, every framing counted. Ranked by the number of answers carrying the site or page. 44 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
28 answers · 30 citations · 11 models
vendor site · CircleCI22 answers · 29 citations · 11 models
21 answers · 21 citations · 8 models
vendor site · Northflank17 answers · 18 citations · 9 models
vendor site · Augment Code17 answers · 17 citations · 9 models
15 answers · 15 citations · 5 models
vendor site · GitHub14 answers · 23 citations · 5 models
vendor site · GitHub14 answers · 19 citations · 8 models
14 answers · 16 citations · 7 models
14 answers · 14 citations · 6 models
publisher (Gane)14 answers · 14 citations · 7 models
13 answers · 21 citations · 10 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
28 answers · 11 models
21 answers · 8 models
16 answers · 8 models
15 answers · 5 models
15 answers · 8 models
14 answers · 7 models
13 answers · 6 models
12 answers · 10 models
10 answers · 7 models
9 answers · 6 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best ci/cd platform”, “ci/cd platform”, “ci/cd platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| GitLab gitlab.com GitLab CI/CD 54% | 54% | 186 | 90,500 | 4,844 | 603,028 company | $884 | 66 | 5 |
| GitHub parent site GitHub Actions 18% | 18% | 181 | 1,500,000 | 31,479 | ||||
| Azure parent site Azure DevOps 11%, Azure Pipelines 2% | 12% | 162 | 301,000 | 47,904 | ||||
| CircleCI circleci.com | 5% | 140 | 4,400 | 207 | 133,932 | 24 | ||
| GitHub github.com | 4% | 216 | 1,500,000 | 31,479 | 42,019,137 | $81 | 14 | 5 |
| Buildkite buildkite.com | 2% | 57 | 3,600 | 98 | 3,563 | $477 | 0 | |
| CloudBees cloudbees.com CloudBees CI 2% | 2% | 11 | 90 | 3 | 128,700 company | $67 | 13 | |
| GitHub Actions on GitHub Enterprise Cloud | 2% | |||||||
| Jenkins jenkins.io Jenkins 2%, Jenkins X 0% | 2% | 151 | 33,100 | 22,088 | 182,143 | |||
| Harness harness.io Harness 0%, Harness CI 0% | 0% | 83 | 60,500 | 55,100 | 86,302 | 6 | 1 |
Google's top ten for the three searches hold 16 sites; 2 of them are among the sites the models cited here (blog.jetbrains.com, github.com). The first result for “best ci/cd platform” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best CI/CD platform for an enterprise B2B company?”Paraphrase“Which continuous integration and delivery tool would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade CI/CD platforms and how do they differ?”Budget-constrained“What is the best CI/CD platform for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a CI/CD platform. What should we look at?”Negative“Which CI/CD platforms should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5Azure DevOps, GitLab CI/CDAzure DevOps, GitLab CI/CDHeldno first choiceBuildkiteagainst: CircleCI, GitHub Actionsno first choiceagainst: Argo CD, Azure DevOps, Drone CI, GitHub Actions, GitLab CI/CD, Jenkins, Travis CI
Three alternatives
Azure DevOps, GitHub, GitLab CI/CDGPT-5.4 miniGitHub Actionsagainst: CircleCI, JenkinsGitLab CI/CDChangedagainst: JenkinsGitHub ActionsGitLab CI/CDagainst: CircleCI, GitHub Actionsno first choiceagainst: CircleCI, GitHub Actions, Jenkins
Two alternatives
Azure DevOps, GitLab CI/CDTwo alternatives
Azure Pipelines, GitHub Actions with self-hosted runnersSix alternatives
Argo CD, Azure DevOps, Azure Pipelines, CircleCI, GitLab CI/CD, JenkinsGemini 3.5 FlashGitHub Actions, GitLab CI/CDagainst: CloudBees CIGitLab CI/CDChangedagainst: JenkinsGitLab CI/CDAzure DevOpsGitHubagainst: AWS CodePipeline, Buddy, CircleCI, Drone OS, Jenkins, Semaphore, ThoughtWorks GoCD, Travis CI
Three alternatives
Argo CD, Azure Pipelines, Harness Continuous Delivery & IntegrationThree alternatives
Azure Pipelines, GitHub Actions, HarnessFive alternatives
Azure Pipelines, CircleCI, CloudBees CI, GitHub Actions, HarnessThree alternatives
Buildkite, GitHub, GitLab CI/CDFour alternatives
Azure DevOps, CloudBees CI, GitLab CI/CD, HarnessPerplexity SonarGitLab CI/CDGitLab CI/CDHeldagainst: JenkinsGitHub ActionsGitLab CI/CDno first choiceagainst: Argo CD, Argo Workflows, Bitbucket Pipelines, CircleCI, GitHub Actions, Jenkins, Tekton
Four alternatives
Azure Pipelines, Buildkite, GitHub Actions, JenkinsThree alternatives
Azure Pipelines, GitHub Actions, Octopus DeployEight alternatives
Argo CD, Azure DevOps, Buildkite, CircleCI, GitLab CI/CD, Harness, Jenkins, Octopus DeployTwo alternatives
GitHub Actions, JenkinsGrok 4.20GitLab CI/CDagainst: CircleCI, JenkinsGitLab CI/CDHeldno first choiceagainst: Travis CICircleCIagainst: GitHub Actions, Harness, JetBrains TeamCity, SemaphoreGitHub Actionsagainst: Jenkins, Travisagainst: Azure DevOps, Azure Pipelines, CircleCI, GitHub Actions, GitLab CI/CD, Harness, Jenkins, Travis CI
Three alternatives
Azure DevOps, Azure Pipelines, GitHub ActionsFour alternatives
Azure DevOps, CircleCI, GitHub Actions, JenkinsFour alternatives
GitHub Actions, GitLab CI/CD, Jenkins, JetBrains TeamCityThree alternatives
Azure DevOps, GitLab CI/CD, JenkinsThree alternatives
CircleCI, GitLab CI/CD, HarnessMistral SmallGitLab CI/CDJenkinsChangedagainst: CircleCIno first choiceCircleCI, GitLab CI/CDagainst: GitHub Actionsno first choiceagainst: CircleCI, Codefresh, IBM Continuous Delivery, Jenkins
Three alternatives
Azure DevOps, Buildkite, GitHub ActionsThree alternatives
Azure DevOps, CloudBees CI, GitLab CI/CDOne alternative
HarnessDeepSeek V4 FlashGitLab CI/CDagainst: JenkinsGitLab CI/CDHeldagainst: Jenkinsno first choiceGitLab CI/CDagainst: Buildkite, CircleCI, GitHub, GitHub ActionsGitHub Actions, GitLab CI/CDagainst: Jenkinsagainst: Atlassian Bamboo, Bitbucket Pipelines, CircleCI, GitHub Actions, Jenkins, JetBrains TeamCity, Travis CI
One alternative
GitHub ActionsThree alternatives
Azure DevOps, GitHub Actions, HarnessTen alternatives
Argo CD, Azure DevOps, Buildkite, CircleCI, CloudBees CI, GitHub Actions, GitLab CI/CD, Harness, Jenkins, SpinnakerOne alternative
JenkinsTwo alternatives
CircleCI, Harness CILlama 4 MaverickGitLab CI/CDno first choiceChangedno first choiceCircleCIno first choiceagainst: BuildJet, CircleCI, Jenkins
Two alternatives
Azure DevOps, GitHub ActionsThree alternatives
Azure DevOps, GitHub Actions, GitLab CI/CDQwen 3.7 FlashGitLab CI/CDagainst: JenkinsGitLab CI/CDHeldno first choiceAzure DevOpsagainst: CircleCI, GitHub ActionsGitHubagainst: AWS CodePipeline, Atlassian Bamboo, CircleCI, GitHub Actions, Google Cloud Build, Hudson, Jenkins, Travis CI
Four alternatives
Azure Pipelines, Buildkite, GitHub Actions, HarnessTwo alternatives
GitHub Actions, JenkinsOne alternative
GitLab CI/CDThree alternatives
CircleCI, GitLab CI/CD, HarnessKimi K2GitHub Actionsagainst: JenkinsGitLab CI/CDChangedagainst: JenkinsGitLab CI/CDagainst: JenkinsGitLab CI/CDagainst: CircleCI, GitHubno first choiceagainst: Azure DevOps, Buildkite, CircleCI, CloudBees CI, GitHub Actions, Harness, Jenkinsagainst: CircleCI, Jenkins, Travis CI
Two alternatives
Azure DevOps, GitLab CI/CDOne alternative
GitHub ActionsFour alternatives
Azure DevOps, CircleCI, GitHub Actions, HarnessOne alternative
Azure DevOpsGLM 4.7 FlashXGitLab CI/CDGitHub ActionsChangedno first choiceGitHub Actions, GitLab CI/CDagainst: Jenkinsno first choiceagainst: Jenkinsagainst: GitHub Actions, Jenkins
Eight alternatives
Azure DevOps, CircleCI, GitHub Actions, Harness, Jenkins, JetBrains TeamCity, Octopus Deploy, SpinnakerFive alternatives
Azure DevOps, CircleCI, GitLab CI/CD, Harness, JenkinsOne alternative
BuildkiteMiniMax M2.5GitHub Actions, GitLab CI/CDAzure DevOps, GitLab CI/CDChangedGitHub ActionsCloudBees CIagainst: GitLab CI/CDno first choiceagainst: Jenkins
Three alternatives
Bitbucket Pipelines, CircleCI, JenkinsThree alternatives
CircleCI, Jenkins X, SpinnakerFour alternatives
Azure Pipelines, CircleCI, GitLab CI/CD, JenkinsOne alternative
BuildkiteGPT-6 LunaGitHub ActionsGitHub Actions on GitHub Enterprise CloudChangedGitHub Actionsagainst: Argo CDAzure Pipelinesagainst: GitHub ActionsGitHub Actionsagainst: AWS CodePipeline, Azure DevOps, CircleCI, GitHub Actions, GitLab CI/CD, Jenkins
Two alternatives
Buildkite, GitLab CI/CDOne alternative
GitLab CI/CDFive alternatives
Azure Pipelines, Buildkite, GitLab CI/CD, Harness, JenkinsOne alternative
GitLab CI/CDThree alternatives
Azure Pipelines, Buildkite, GitLab CI/CDMuse Glimmer 30BGitLab CI/CDagainst: JenkinsGitLab CI/CDHeldagainst: CloudBees CI, Jenkinsno first choiceAzure DevOps, GitLab CI/CDagainst: GitHub Actionsno first choiceagainst: GitHub Actions, Jenkins, JetBrains TeamCity, Travis CI
Two alternatives
Azure Pipelines, GitHub ActionsTwo alternatives
Azure DevOps, GitHub ActionsBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 15:38 | no | 0 | 5 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 15:42 | yes | 5 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 18:10 | no | 0 | 16 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 19:14 | yes | 10 | 5 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 19:35 | yes | 5 | 10 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 09:58 | yes | 5 | 5 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 09:32 | yes | 23 | 25 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 19:22 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 12:45 | yes | 5 | 35 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 15:07 | yes | 15 | 27 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 15:42 | yes | 18 | 118 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 12:04 | yes | 5 | 19 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 13:33 | yes | 3 | 12 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 16:16 | yes | 14 | 26 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 16:10 | no | 0 | 4 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 17:17 | yes | 4 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 09:34 | no | 0 | 13 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 16:49 | yes | 10 | 3 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:59 | yes | 5 | 8 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 16:08 | no | 0 | 3 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 13:25 | yes | 14 | 24 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 09:12 | yes | 5 | 3 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:19 | yes | 5 | 21 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 11:16 | yes | 10 | 81 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 17:05 | yes | 13 | 22 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 13:37 | no | 0 | 9 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 09:26 | yes | 2 | 14 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 09:03 | yes | 14 | 19 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 09:32 | yes | 9 | 8 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 08:59 | yes | 7 | 9 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 14:58 | no | 0 | 21 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 13:32 | yes | 10 | 6 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:32 | yes | 5 | 18 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 17:31 | yes | 13 | 16 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 09:55 | yes | 19 | 28 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 15:41 | yes | 5 | 3 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 15:09 | no | 0 | 30 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 14:41 | yes | 14 | 36 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 09:34 | yes | 9 | 27 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 11:01 | yes | 9 | 58 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 19:21 | yes | 12 | 28 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 10:21 | yes | 12 | 28 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 18:55 | yes | 19 | 10 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 12:39 | yes | 4 | 6 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 15:16 | no | 0 | 20 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 17:32 | yes | 10 | 4 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 18:00 | yes | 5 | 14 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 12:09 | yes | 5 | 12 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 17:42 | yes | 19 | 30 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 17:46 | yes | 5 | 3 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 11:53 | yes | 9 | 41 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 10:41 | yes | 24 | 41 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 15:41 | yes | 25 | 32 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 14:22 | yes | 25 | 67 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 12:14 | yes | 2 | 16 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 19:22 | yes | 20 | 41 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 18:18 | yes | 18 | 13 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 16:43 | yes | 4 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 09:03 | no | 0 | 18 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 08:41 | yes | 10 | 9 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:20 | yes | 5 | 13 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 12:27 | no | 0 | 10 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 18:03 | yes | 23 | 56 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 17:03 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 09:10 | no | 0 | 33 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 14:47 | no | 0 | 49 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 14:32 | yes | 15 | 17 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 16:24 | no | 0 | 25 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 16:01 | yes | 5 | 28 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 11:58 | yes | 15 | 28 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 17:48 | yes | 15 | 10 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 12:37 | yes | 5 | 7 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 09:16 | yes | 4 | 22 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 12:57 | yes | 10 | 5 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:56 | yes | 13 | 17 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 13:17 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 12:16 | yes | 25 | 33 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:48 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 17:19 | no | 0 | 33 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 16:22 | yes | 24 | 63 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:01 | yes | 25 | 53 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 09:30 | yes | 10 | 57 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 10:16 | yes | 6 | 14 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 16:44 | yes | 13 | 30 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
AWS CodePipeline / CodeBuild read as AWS CodePipeline
CloudBees read as CloudBees CI
CloudBees (Enterprise Jenkins) read as CloudBees CI
CloudBees (Jenkins Enterprise) read as CloudBees CI
GitLab read as GitLab CI/CD
GitLab (GitLab Ultimate) read as GitLab CI/CD
GitLab (Self-Managed) read as GitLab CI/CD
GitLab (Ultimate Tier) read as GitLab CI/CD
GitLab (Ultimate tier) read as GitLab CI/CD
GitLab CI read as GitLab CI/CD
GitLab Dedicated read as GitLab CI/CD
GitLab Enterprise read as GitLab CI/CD
GitLab Premium read as GitLab CI/CD
GitLab Premium/Ultimate read as GitLab CI/CD
GitLab Self-Managed read as GitLab CI/CD
GitLab Ultimate read as GitLab CI/CD
Unresolved, counted raw
AWS CodeDeploy
Drone OS
Gearset
GitHub Actions on GitHub Enterprise Cloud
GitHub Actions with self-hosted runners
Harness CI
Harness Continuous Delivery & Integration
Hudson
IBM Continuous Delivery (Airframe)
OpenShift Pipelines
ThoughtWorks GoCD
Discontinued, still offered
No shut-down product was recommended here.