CI/CD platforms
Asked as “CI/CD platform”, and as “continuous integration and delivery tool”, on behalf of a mid-market B2B company. 56 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
70%
Clear leader
70GitHub Actions30GitLab CI/CD
70% of first choices, clear leader.
Since October 2026▲+2Since October 2026: 68% → 70%, +2 points. Inside the 11-point floor: within noise.GitHub Actions held the lead, +2 points on 68%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
GitHub Actions88%Clear leader▲+13Since October 2026: 75% → 88%, +13 points. Past the 11-point floor: movement.Standing →Mid-marketGitHub Actions70%Clear leader▲+2Since October 2026: 68% → 70%, +2 points. Inside the 11-point floor: within noise.This pageEnterprise
GitLab CI/CD54%Clear leader▲+12Since October 2026: 42% → 54%, +12 points. Past the 11-point floor: movement.Standing →
GitHub Actions88%Clear leader▲+13Since October 2026: 75% → 88%, +13 points. Past the 11-point floor: movement.Standing →Mid-marketGitHub Actions70%Clear leader▲+2Since October 2026: 68% → 70%, +2 points. Inside the 11-point floor: within noise.This pageEnterpriseGitLab CI/CD54%Clear leader▲+12Since October 2026: 42% → 54%, +12 points. Past the 11-point floor: movement.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01GitHub Actions70%8%75endorsed leader▲+2Since October 2026: 68% → 70%, +2 points. Inside the 11-point floor: within noise.68% → 70%
GitHub Actions70%8%75endorsed leader▲+2Since October 2026: 68% → 70%, +2 points. Inside the 11-point floor: within noise.68% → 70%02GitLab CI/CD30%10%79endorsed leader▲+7Since October 2026: 23% → 30%, +7 points. Inside the 11-point floor: within noise.23% → 30%
GitLab CI/CD30%10%79endorsed leader▲+7Since October 2026: 23% → 30%, +7 points. Inside the 11-point floor: within noise.23% → 30%Show the eleven products at 0%, ordered by negative rate
12
Travis CI0%83%12criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Travis CI0%83%12criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%13
Jenkins0%62%66criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Jenkins0%62%66criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%11
JetBrains TeamCity0%46%13criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
JetBrains TeamCity0%46%13criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%10
AWS CodePipeline0%25%12criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
AWS CodePipeline0%25%12criticized challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%09
Bitbucket Pipelines0%21%14accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Bitbucket Pipelines0%21%14accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%03
CircleCI0%17%58accepted challenger▼−4Since October 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise.4% → 0%
CircleCI0%17%58accepted challenger▼−4Since October 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise.4% → 0%06
Azure DevOps0%17%24accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Azure DevOps0%17%24accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%05
Buildkite0%13%23accepted challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%
Buildkite0%13%23accepted challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise.2% → 0%04
Azure Pipelines0%10%21accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Azure Pipelines0%10%21accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%08
Argo CD0%7%15accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Argo CD0%7%15accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%07
Harness0%0%16accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Harness0%0%16accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Head to head
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01020304050607080910111213Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative80%
Key
01GitHub Actions70%
GitHub Actions70%02GitLab CI/CD30%
GitLab CI/CD30%03CircleCI0%
CircleCI0%04Azure Pipelines0%
Azure Pipelines0%05Buildkite0%
Buildkite0%06Azure DevOps0%
Azure DevOps0%07Harness0%
Harness0%08Argo CD0%
Argo CD0%09Bitbucket Pipelines0%
Bitbucket Pipelines0%10AWS CodePipeline0%
AWS CodePipeline0%11JetBrains TeamCity0%
JetBrains TeamCity0%12Travis CI0%
Travis CI0%13Jenkins0%
Jenkins0%What they warned about
Six of fourteen models held their first choice under the paraphrase. GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Mistral Small, DeepSeek V4 Flash, Kimi K2, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Jenkins62%
41 of 66 labels negative · 14 of 14 models · 12 hard negative
“Many mid-sized teams are migrating *away* from it due to operational burden—avoid unless you have dedicated DevOps staff for it.” Grok 4.20, paraphrase prompt
GitLab CI/CD10%
8 of 79 labels negative · 8 of 14 models
“Self-hosted installations of any platform without a security owner: Jenkins, GitLab, TeamCity, and similar systems can be risky” Perplexity Sonar, negative prompt
Travis CI83%
10 of 12 labels negative · 7 of 14 models · 4 hard negative
“❌ Travis CI * Why avoid: Once the gold standard for open-source CI, Travis CI declined significantly” Gemini 3.5 Flash, negative prompt
CircleCI17%
10 of 58 labels negative · 6 of 14 models · 2 hard negative
“Uses heavy usage-based pricing that can spiral out of control, especially for large teams.” Mistral Small, negative prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
65 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 653 links across 208 sites, every framing counted. Ranked by the number of answers carrying the site or page. 44 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · Northflank25 answers · 27 citations · 10 models
24 answers · 27 citations · 12 models
vendor site · GitHub18 answers · 30 citations · 8 models
17 answers · 29 citations · 7 models
16 answers · 21 citations · 7 models
vendor site · CircleCI15 answers · 19 citations · 7 models
vendor site · Atlassian14 answers · 16 citations · 8 models
12 answers · 13 citations · 7 models
publisher (Gane)12 answers · 13 citations · 6 models
12 answers · 12 citations · 7 models
12 answers · 12 citations · 7 models
11 answers · 11 citations · 6 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
22 answers · 11 models
22 answers · 10 models
12 answers · 7 models
12 answers · 7 models
12 answers · 7 models
12 answers · 6 models
12 answers · 6 models
10 answers · 6 models
10 answers · 5 models
10 answers · 6 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best ci/cd platform”, “ci/cd platform”, “ci/cd platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| GitHub parent site GitHub Actions 70% | 70% | 181 | 1,500,000 | 31,479 | ||||
| GitLab gitlab.com GitLab CI/CD 30% | 30% | 186 | 90,500 | 4,844 | 603,028 company | $884 | 66 | 5 |
| CircleCI circleci.com | 0% | 140 | 4,400 | 207 | 133,932 | 24 | ||
| Azure parent site Azure Pipelines 0%, Azure DevOps 0% | 0% | 162 | 301,000 | 47,904 | ||||
| Buildkite buildkite.com | 0% | 57 | 3,600 | 98 | 3,563 | $477 | 0 | |
| Harness harness.io | 0% | 83 | 60,500 | 55,100 | 86,302 | 6 | 1 | |
| Argo argoproj.io Argo CD 0%, Argo 0%, Argo Workflows 0% | 0% | 34 | 3,600 | 240 | 182 company | |||
| Bitbucket Pipelines bitbucket.org | 0% | 28 | 590 | 97 | 22,601 | |||
| Drone CI drone.io | 0% | 9 | ||||||
| AWS parent site AWS CodePipeline 0% | 0% | 18 | 368,000 | 114,001 |
Google's top ten for the three searches hold 16 sites; 3 of them are among the sites the models cited here (atlassian.com, blog.jetbrains.com, github.com). The first result for “best ci/cd platform” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best CI/CD platform for a mid-market B2B company?”Paraphrase“Which continuous integration and delivery tool would you recommend to a mid-sized B2B company?”Comparative“What are the top CI/CD platforms and how do they differ?”Budget-constrained“What is the best CI/CD platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a CI/CD platform. What should we look at?”Negative“Which CI/CD platforms should I avoid or be cautious about?”
Claude Haiku 4.5GitHub Actions, GitLab CI/CDagainst: JenkinsGitHub Actions, GitLab CI/CDHeldagainst: JenkinsGitHub Actions, GitLab CI/CDGitHub Actionsno first choicenothing named
One alternative
CircleCIFour alternatives
Argo CD, Buildkite, CircleCI, JenkinsThree alternatives
CircleCI, GitLab CI/CD, JenkinsGPT-5.4 miniGitLab CI/CDGitHub ActionsChangedagainst: JenkinsGitHub ActionsGitHub Actions, GitLab CI/CDno first choiceagainst: Jenkins
Two alternatives
CircleCI, GitHub ActionsTwo alternatives
CircleCI, GitLab CI/CDThree alternatives
CircleCI, GitLab CI/CD, JenkinsOne alternative
CircleCIGemini 3.5 FlashGitHub Actions, GitLab CI/CDGitHub ActionsChangedagainst: Buildkite, CircleCI, JenkinsGitHub ActionsGitHub Actions, GitLab CI/CDagainst: Jenkinsno first choiceagainst: Jenkinsagainst: AWS CodeBuild, AWS CodePipeline, Atlassian Bamboo, CircleCI, Jenkins, Travis CI
Four alternatives
Argo CD, Buildkite, Harness, Octopus DeployThree alternatives
Argo CD, GitLab CI/CD, Octopus DeployFour alternatives
Azure Pipelines, CircleCI, GitLab CI/CD, JenkinsThree alternatives
Bitbucket Pipelines, Drone CI, Woodpecker CIPerplexity SonarGitHub Actionsagainst: JenkinsGitLab CI/CDChangedagainst: JenkinsGitHub Actions, GitLab CI/CDGitHub Actionsno first choiceagainst: Atlassian Bamboo, GitLab CI/CD, Jenkins, JetBrains TeamCity, Travis CI
Two alternatives
Buildkite, GitLab CI/CDFour alternatives
AWS CodePipeline, Argo CD, GitHub Actions, Octopus DeploySeven alternatives
Argo CD, Azure Pipelines, Buildkite, CircleCI, Harness, Jenkins, JetBrains TeamCityThree alternatives
GitLab CI/CD, Jenkins, SemaphoreGrok 4.20GitHub Actionsagainst: JenkinsGitHub ActionsHeldagainst: Bitbucket Pipelines, CircleCI, JenkinsGitHub ActionsGitHub Actionsagainst: Azure Pipelines, Buildkite, CircleCIno first choiceagainst: Jenkinsagainst: Atlassian tools, CircleCI, Confluence, GitHub Actions, GitLab CI/CD, Jenkins, JetBrains TeamCity, Travis CI
Two alternatives
GitLab CI/CD, SemaphoreThree alternatives
Azure DevOps, Azure Pipelines, GitLab CI/CDFour alternatives
Azure DevOps, CircleCI, GitLab CI/CD, JenkinsFive alternatives
Bitbucket Pipelines, Drone CI, GitLab CI/CD, Jenkins, Woodpecker CIMistral SmallGitHub Actionsno first choiceChangedno first choiceagainst: AWS CodePipeline, Jenkins, JetBrains TeamCity, Travis CIGitHub Actionsno first choiceagainst: Jenkins, Spinnakeragainst: AWS CodePipeline, Azure Pipelines, Bitbucket Pipelines, CircleCI, GitLab CI/CD, Jenkins, Travis CI
One alternative
GitLab CI/CDThree alternatives
CircleCI, GitLab CI/CD, JenkinsDeepSeek V4 FlashGitHub Actionsagainst: JenkinsGitLab CI/CDChangedagainst: JenkinsGitHub Actionsagainst: Travis CIGitHub Actionsno first choiceagainst: Jenkinsagainst: Atlassian Bamboo, Buildkite, CircleCI, Concourse, Drone CI, GitHub Actions, GitLab CI/CD, Jenkins, Travis CI
Two alternatives
CircleCI, GitLab CI/CDThree alternatives
Azure DevOps, CircleCI, GitHub ActionsSix alternatives
AWS CodePipeline, Azure Pipelines, Buildkite, CircleCI, GitLab CI/CD, JenkinsTwo alternatives
GitLab CI/CD, JenkinsLlama 4 MaverickGitHub ActionsGitHub ActionsHeldno first choiceGitHub Actionsno first choiceagainst: Azure DevOps, Bitbucket Pipelines, CircleCI, Jenkins, JetBrains TeamCity
Three alternatives
CircleCI, GitLab CI/CD, JenkinsThree alternatives
Buildkite, CircleCI, GitLab CI/CDQwen 3.7 FlashGitHub Actions, GitLab CI/CDagainst: Atlassian Bamboo, JenkinsGitHub Actions, GitLab CI/CDHeldagainst: JenkinsGitHub ActionsGitHub Actionsagainst: JenkinsGitHub Actions, GitLab CI/CDagainst: Jenkins, JetBrains TeamCityagainst: Atlassian Bitbucket Pipelines, Azure DevOps, GitHub Actions, Jenkins, Travis CI
One alternative
CircleCIOne alternative
CircleCIFour alternatives
Azure DevOps, CircleCI, GitLab CI/CD, JenkinsTwo alternatives
Azure DevOps, GitLab CI/CDThree alternatives
Azure DevOps, CircleCI, Travis CIKimi K2GitHub Actions, GitLab CI/CDagainst: JenkinsGitLab CI/CDChangedagainst: Azure DevOps, CircleCI, Jenkinsno first choiceagainst: JetBrains TeamCity, Travis CIGitHub Actionsagainst: GitLab CI/CDGitHub Actions, GitLab CI/CDagainst: Argo CD, Flux, Jenkins, Spinnakeragainst: Atlassian Bamboo, CircleCI, Jenkins, Travis CI
Two alternatives
Azure Pipelines, CircleCIOne alternative
GitHub ActionsTwo alternatives
CircleCI, JenkinsOne alternative
BuildkiteGLM 4.7 FlashXGitHub ActionsGitHub Actions, GitLab CI/CDChangedno first choiceGitHub ActionsGitHub Actionsagainst: Jenkinsagainst: Azure DevOps, GitHub Actions, GitLab CI/CD, Jenkins
Four alternatives
Azure Pipelines, Bitbucket Pipelines, CircleCI, GitLab CI/CDOne alternative
Azure PipelinesTen alternatives
AWS CodePipeline, Atlassian Bamboo, Azure DevOps, Buddy, CircleCI, GitHub Actions, GitLab CI/CD, Jenkins, JetBrains TeamCity, SpinnakerThree alternatives
CircleCI, GitLab CI/CD, JenkinsFour alternatives
Azure DevOps, CircleCI, GitLab CI/CD, JetBrains TeamCityMiniMax M2.5GitLab CI/CDagainst: JenkinsGitHub ActionsChangedGitHub Actions, GitLab CI/CDagainst: JenkinsGitHub Actions, GitLab CI/CDno first choiceagainst: Bitbucket, GitHub, GitLab CI/CD, Jenkins
One alternative
GitHub ActionsThree alternatives
Azure DevOps, GitLab CI/CD, JenkinsTwo alternatives
Azure Pipelines, CircleCIThree alternatives
Bitbucket Pipelines, CircleCI, JenkinsGPT-6 LunaGitHub ActionsGitHub ActionsHeldno first choiceGitHub Actionsno first choiceagainst: GitHub Actions, GitLab CI/CD, JFrog Pipelines, Jenkins
Two alternatives
Buildkite, GitLab CI/CDThree alternatives
Argo CD, Buildkite, GitLab CI/CDSeven alternatives
Azure Pipelines, Bitbucket Pipelines, Buildkite, CircleCI, GitHub Actions, GitLab CI/CD, JenkinsTwo alternatives
CircleCI, GitLab CI/CDMuse Glimmer 30BGitHub Actionsagainst: JenkinsGitHub ActionsHeldagainst: JenkinsGitHub ActionsGitHub Actionsno first choiceagainst: Atlassian Bamboo Server, BuildJet, CloudBees CodeShip, Earthly, GitHub Actions, Jenkins, Travis CI legacy service
Three alternatives
Azure DevOps, CircleCI, GitLab CI/CDOne alternative
GitLab CI/CDThree alternatives
CircleCI, GitLab CI/CD, JenkinsThree alternatives
CircleCI, GitLab CI/CD, JenkinsBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 13:31 | no | 0 | 5 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 12:40 | yes | 3 | 4 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 17:28 | yes | 11 | 18 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 15:49 | yes | 10 | 4 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:54 | yes | 5 | 13 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 12:06 | yes | 5 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 15:40 | yes | 19 | 22 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 16:24 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 17:11 | no | 0 | 26 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 12:17 | yes | 9 | 61 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 09:10 | yes | 18 | 32 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:57 | yes | 9 | 51 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 16:54 | yes | 4 | 13 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 11:53 | yes | 13 | 23 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 10:20 | no | 0 | 5 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 10:21 | no | 0 | 3 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 11:11 | no | 0 | 15 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 11:55 | yes | 10 | 3 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 18:58 | yes | 5 | 8 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 16:17 | no | 0 | 1 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 14:06 | yes | 19 | 26 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 14:49 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:07 | no | 0 | 28 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 19:14 | yes | 10 | 33 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 17:39 | yes | 19 | 72 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 09:11 | yes | 5 | 26 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 15:38 | yes | 4 | 8 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 13:05 | yes | 13 | 19 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 19:06 | yes | 9 | 8 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 14:17 | yes | 7 | 8 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 12:35 | no | 0 | 17 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 18:08 | yes | 10 | 7 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:07 | yes | 5 | 16 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 18:51 | yes | 5 | 9 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 12:53 | yes | 19 | 31 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 10:28 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 13:18 | yes | 5 | 25 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 17:12 | yes | 18 | 38 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 19:42 | yes | 10 | 40 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 12:05 | yes | 10 | 21 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 10:47 | yes | 8 | 16 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 09:58 | yes | 20 | 32 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 16:50 | yes | 9 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 13:28 | yes | 3 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 12:52 | no | 0 | 16 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 12:05 | yes | 10 | 3 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:45 | yes | 5 | 12 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 10:38 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 16:38 | yes | 14 | 27 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:09 | yes | 6 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 15:20 | no | 0 | 27 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 13:16 | yes | 10 | 31 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 10:18 | yes | 20 | 23 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:12 | no | 0 | 16 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 19:22 | yes | 3 | 11 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 17:27 | yes | 14 | 19 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 16:31 | no | 0 | 7 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 14:11 | no | 0 | 6 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 16:52 | no | 0 | 21 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 11:52 | yes | 10 | 8 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 16:22 | yes | 5 | 16 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 17:26 | no | 0 | 9 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:41 | yes | 22 | 51 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 16:59 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 16:12 | yes | 7 | 54 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 08:39 | no | 0 | 80 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 15:15 | yes | 14 | 80 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 12:50 | no | 0 | 23 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 17:33 | yes | 4 | 19 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 14:11 | no | 0 | 7 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 12:21 | no | 0 | 2 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 14:11 | yes | 4 | 7 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 18:06 | yes | 7 | 22 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 11:44 | yes | 10 | 4 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 19:18 | yes | 5 | 10 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 17:42 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 13:03 | yes | 23 | 36 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 09:57 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 09:37 | yes | 10 | 30 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 08:56 | yes | 25 | 26 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 12:20 | yes | 23 | 74 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 13:45 | yes | 10 | 20 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 18:50 | yes | 5 | 16 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 16:41 | yes | 23 | 35 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
AWS CodePipeline/CodeBuild read as AWS CodePipeline
Drone read as Drone CI
GitLab read as GitLab CI/CD
GitLab CE read as GitLab CI/CD
GitLab CI read as GitLab CI/CD
GitLab Premium read as GitLab CI/CD
Unresolved, counted raw
Atlassian Bamboo Server
Atlassian tools (e.g., Bamboo, or integrated with Jira/Bitbucket)
Bitbucket Cloud Pipelines
Cirun
CloudBees CodeShip
Codecov
Concourse
Semaphore CI
Stormkit
Travis CI legacy service
Discontinued, still offered
No shut-down product was recommended here.