AI coding assistants
Asked as “AI coding assistant”, and as “AI pair programming tool”, on behalf of a mid-market B2B company. 45 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
80%
Clear leader
80GitHub Copilot04Windsurf02Aider13others
80% of first choices, clear leader.
Since October 2026▲+5Since October 2026: 75% → 80%, +5 points. Inside the 11-point floor: within noise.GitHub Copilot held the lead, +5 points on 75%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
GitHub Copilot73%Clear leader▲+10Since October 2026: 63% → 73%, +10 points. Inside the 11-point floor: within noise.Standing →Mid-marketGitHub Copilot80%Clear leader▲+5Since October 2026: 75% → 80%, +5 points. Inside the 11-point floor: within noise.This pageEnterpriseGitHub Copilot86%Clear leader▲+4Since October 2026: 82% → 86%, +4 points. Inside the 11-point floor: within noise.Standing →
GitHub Copilot73%Clear leader▲+10Since October 2026: 63% → 73%, +10 points. Inside the 11-point floor: within noise.Standing →Mid-marketGitHub Copilot80%Clear leader▲+5Since October 2026: 75% → 80%, +5 points. Inside the 11-point floor: within noise.This pageEnterpriseGitHub Copilot86%Clear leader▲+4Since October 2026: 82% → 86%, +4 points. Inside the 11-point floor: within noise.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01GitHub Copilot80%12%80endorsed leader▲+5Since October 2026: 75% → 80%, +5 points. Inside the 11-point floor: within noise.75% → 80%
GitHub Copilot80%12%80endorsed leader▲+5Since October 2026: 75% → 80%, +5 points. Inside the 11-point floor: within noise.75% → 80%02
Windsurf4%11%27accepted challenger▼−10Since October 2026: 14% → 4%, −10 points. Inside the 11-point floor: within noise.14% → 4%
Windsurf4%11%27accepted challenger▼−10Since October 2026: 14% → 4%, −10 points. Inside the 11-point floor: within noise.14% → 4%03
Tabnine2%3%39accepted challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%
Tabnine2%3%39accepted challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise.2% → 2%04
Cursor2%25%63criticized challenger▼−2Since October 2026: 4% → 2%, −2 points. Inside the 11-point floor: within noise.4% → 2%
Cursor2%25%63criticized challenger▼−2Since October 2026: 4% → 2%, −2 points. Inside the 11-point floor: within noise.4% → 2%05
Aider2%7%14accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%
Aider2%7%14accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%06
Cline2%9%11accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%
Cline2%9%11accepted challenger▲+2Since October 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise.0% → 2%Show the five products at 0%, ordered by negative rate
08
Claude Code Lab in the set0%21%29accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Claude Code Lab in the set0%21%29accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%11Gemini Code Assist Lab in the set0%20%10accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
07
Amazon Q Developer0%9%43accepted challenger▼−4Since October 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise.4% → 0%
Amazon Q Developer0%9%43accepted challenger▼−4Since October 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise.4% → 0%09
Sourcegraph Cody0%8%12accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
Sourcegraph Cody0%8%12accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%10
JetBrains AI Assistant0%0%11accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%
JetBrains AI Assistant0%0%11accepted challenger=heldSince October 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Claude Code is made by Anthropic, whose model Claude Haiku 4.5 is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models zero times of 52. Gemini Code Assist is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models zero times of 52. Lab treatment is defined on the method page; the row is marked, not excluded.
All fifteen head-to-head pages: the top six products, each against each
One product takes 80% of first choices here, so the chart would put ten markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. One product carries a negative rate above 25% in this category.
What they warned about
Twelve of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5 and GPT-5.4 mini changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Cursor25%
16 of 63 labels negative · 11 of 14 models · 1 hard negative
“Verdict: Use with extreme caution, especially without enterprise controls and Privacy Mode explicitly enabled.” Kimi K2, negative prompt
GitHub Copilot12%
10 of 80 labels negative · 9 of 14 models
“GitHub explicitly warns that Copilot CLI and cloud-agent workflows need extra caution around command execution, sensitive information, and inaccurate code.” GPT-5.4 mini, negative prompt
Amazon Q Developer9%
4 of 43 labels negative · 4 of 14 models · 1 hard negative
“Shut down and folded into Amazon Q Developer in 2024... Avoid entirely: Discontinued tools (CodeWhisperer, Kite, Builder.ai)” DeepSeek V4 Flash, negative prompt
Claude Code21%
6 of 29 labels negative · 4 of 14 models · 1 hard negative
“Verdict: Avoid for sensitive or regulated environments; geopolitical concerns add extra risk layer.” Kimi K2, negative prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
71 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 795 links across 316 sites, every framing counted. Ranked by the number of answers carrying the site or page. 61 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · GitHub22 answers · 50 citations · 8 models
19 answers · 28 citations · 12 models
publisher (Gane)18 answers · 19 citations · 10 models
vendor site · Superblocks17 answers · 22 citations · 11 models
vendor site · GitHub13 answers · 27 citations · 5 models
12 answers · 13 citations · 8 models
vendor site · Daily11 answers · 12 citations · 10 models
11 answers · 11 citations · 8 models
10 answers · 12 citations · 8 models
vendor site · Cursor9 answers · 14 citations · 4 models
vendor site · OWASP9 answers · 9 citations · 7 models
vendor site · Zapier9 answers · 9 citations · 4 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
14 answers · 10 models
11 answers · 8 models
10 answers · 7 models
10 answers · 8 models
9 answers · 8 models
9 answers · 7 models
9 answers · 6 models
8 answers · 4 models
7 answers · 6 models
6 answers · 3 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “ai coding assistant”, “ai coding assistants”, “best ai coding assistant”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| GitHub github.com GitHub Copilot 80% | 80% | 207 | 1,500,000 | 31,479 | 42,019,137 company | $81 | 14 | |
| Windsurf windsurf.com | 4% | 66 | 60,500 | 4,501 | 21,603 | 0 | ||
| Tabnine tabnine.com | 2% | 89 | 2,900 | 62 | 15,577 | 0 | ||
| Cursor cursor.com | 2% | 164 | 301,000 | 22,500 | 350,718 | $28 | 119 | 6 |
| Aider aider.chat | 2% | 20 | 9,900 | 585 | 5,507 | |||
| Continue continue.dev | 2% | 19 | 673,000 | 70,608 | 2,964 | |||
| Cline cline.bot | 2% | 23 | 22,200 | 8,724 | 12,658 | 3 | ||
| Claude claude.com Claude 2%, Claude Code 0% | 2% | 92 | 5,000,000 | 53,240 | 3,090,945 | $1,889 | 120 | |
| GitHub Copilot Business or Enterprise | 2% | |||||||
| Amazon Q amazon.com Amazon Q Developer 0% | 0% | 109 | 9,900 | 738 | 1,681,997,879 company | $106,125 | 115 |
Google's top ten for the three searches hold 24 sites; 1 of them are among the sites the models cited here (cursor.com). The first result for “ai coding assistant” is augmentcode.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best AI coding assistant for a mid-market B2B company?”Paraphrase“Which AI pair programming tool would you recommend to a mid-sized B2B company?”Comparative“What are the top AI coding assistants and how do they differ?”Budget-constrained“What is the best AI coding assistant for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating an AI coding assistant. What should we look at?”Negative“Which AI coding assistants should I avoid or be cautious about?”
Claude Haiku 4.5Claude, GitHub CopilotGitHub CopilotChangedGitHub Copilotno first choiceno first choiceagainst: AI Dev Helper, AutoCoder 3000, CodeBuddy, CodeGen Pro, Cursor, GitHub Copilot, IntelliAssist, QuickScript, SmartCode AI
Three alternatives
Claude Code, Tabnine, WindsurfFive alternatives
Amazon Q Developer, Claude, Cursor, Playcode AI, WindsurfGPT-5.4 miniGitHub Copilot Business or Enterpriseagainst: Gemini Code AssistGitHub CopilotChangedGitHub CopilotGitHub Copilotagainst: Cursor, GitHub Copilotno first choiceagainst: GitHub Copilot
Two alternatives
Amazon Q Developer, CursorOne alternative
CursorThree alternatives
Amazon Q Developer, Claude Code, CursorGemini 3.5 FlashGitHub CopilotGitHub CopilotHeldCursor, WindsurfAider, Clineagainst: Cursor, Devinno first choicenothing named
Three alternatives
Cursor, Tabnine, WindsurfTwo alternatives
Cursor, TabnineSix alternatives
Amazon Q Developer, Claude Code, Cline, Continue, GitHub Copilot, JetBrains AI AssistantFour alternatives
GitHub Copilot, Ollama, Tabby, WindsurfPerplexity SonarGitHub CopilotGitHub CopilotHeldGitHub CopilotGitHub Copilotagainst: Claude Code, Cursorno first choiceagainst: Aider, Claude Code, Copilot Workspace, Cursor, Devin, OpenAI Codex
Three alternatives
Claude Code, Cursor, TabnineFour alternatives
Amazon Q Developer, Cursor, Sourcegraph Cody, TabnineSeven alternatives
Amazon Q Developer, Claude Code, Cursor, Gemini Code Assist, OpenAI Codex, Replit Agent, TabnineTwo alternatives
Aider, ClineGrok 4.20GitHub CopilotGitHub CopilotHeldCursor, GitHub Copilotagainst: DevinGitHub Copilotagainst: Cursorno first choiceagainst: Amazon Q Developer, ChatGPT, Claude, Cursor, Gemini Code Assist, GitHub Copilot, Tabnine, Windsurf
Five alternatives
Amazon Q Developer, Anthropic, Claude Code, Cursor, Gemini Code AssistThree alternatives
Amazon Q Developer, Cursor, TabnineFive alternatives
Aider, Amazon Q Developer, Claude, Continue, TabnineFour alternatives
Claude, Claude Code, Continue, WindsurfThree alternatives
GitHub Copilot, Sourcegraph Cody, TabnineMistral SmallGitHub CopilotGitHub CopilotHeldGitHub CopilotGitHub Copilotno first choiceagainst: Cursor, Devin, GitHub Copilot
Three alternatives
Claude Code, Cursor, SuperblocksFive alternatives
Amazon Q Developer, MutableAI, Qodo, Replit AI, TabnineTwo alternatives
DeepSeek Coder, Devin AIDeepSeek V4 FlashGitHub CopilotGitHub CopilotHeldagainst: CursorCursor, GitHub CopilotGitHub Copilotno first choiceagainst: Amazon Q Developer, Builder.ai, Claude Code, Cursor, GitHub Copilot, Kite, OpenAI's Codex, Sourcegraph Cody, Windsurf
Four alternatives
Amazon Q Developer, Claude Code, Cursor, Sourcegraph CodyTwo alternatives
Amazon Q Developer, TabnineSix alternatives
Aider, Amazon Q Developer, Cline, Sourcegraph Cody, Tabnine, WindsurfFour alternatives
Aider, Amazon Q Developer, Continue, CursorLlama 4 MaverickGitHub CopilotGitHub CopilotHeldno first choiceContinueno first choicenothing named
Three alternatives
Claude Code, Cursor, WindsurfOne alternative
CursorFour alternatives
Aider, Cline, Cursor, GitHub CopilotQwen 3.7 FlashGitHub CopilotGitHub CopilotHeldCursorGitHub Copilot, Windsurfno first choiceagainst: OpenAI ChatGPT/GPT models
Four alternatives
Anthropic, Augment Code, Claude Code, CursorThree alternatives
Amazon Q Developer, Cursor, TabnineFive alternatives
Claude Code, GitHub Copilot, OpenAI's Codex, Replit Agent, WindsurfTwo alternatives
Aider, ClineKimi K2GitHub Copilotagainst: CursorGitHub CopilotHeldGitHub CopilotGitHub Copilotagainst: Claude Code, Cursorno first choiceagainst: Amazon Q Developer, Claude Code, Cursor, GitHub Copilot, OpenAI Codex
Two alternatives
Amazon Q Developer, TabnineThree alternatives
Amazon Q Developer, Cursor, TabnineSix alternatives
Amazon Q Developer, Claude Code, Cursor, Gemini Code Assist, OpenAI Codex, Replit AIThree alternatives
Amazon Q Developer, Continue, WindsurfGLM 4.7 FlashXGitHub CopilotGitHub CopilotHeldagainst: WindsurfCursor, GitHub CopilotWindsurfagainst: Coders in Flowno first choiceagainst: Anthropic's Claude Desktop, ChatGPT, Claude Code, Cline, Cursor, GitHub Copilot, Jules, Microsoft VS Code, OpenAI Codex
Two alternatives
Tabnine, WindsurfTwo alternatives
Cursor, JetBrains AI AssistantThree alternatives
Amazon Q Developer, Claude Code, TabnineFive alternatives
Aider, Amazon Q Developer, Cline, Continue, GitHub CopilotMiniMax M2.5GitHub CopilotGitHub CopilotHeldGitHub CopilotCursor, Tabnineno first choicenothing named
Four alternatives
Amazon Q Developer, Claude Code, Cursor, Sourcegraph CodyFour alternatives
Amazon Q Developer, Cursor, JetBrains AI Assistant, TabnineFive alternatives
Amazon Q Developer, Claude Code, Cursor, Tabnine, WindsurfTwo alternatives
Amazon Q Developer, GitHub CopilotGPT-6 LunaGitHub CopilotGitHub CopilotHeldno first choiceGitHub Copilotno first choiceagainst: Cursor, GitHub Copilot
Two alternatives
Claude Code, CursorOne alternative
CursorSeven alternatives
Claude Code, Cursor, GitHub Copilot, Google Antigravity, JetBrains AI Assistant, JetBrains Junie, OpenAI CodexMuse Glimmer 30BGitHub CopilotGitHub CopilotHeldCursor, GitHub CopilotGitHub Copilotno first choiceagainst: Amazon Q Developer, Cursor, GitHub Copilot, Windsurf, formerly Codeium
Three alternatives
Amazon Q Developer, Cursor, TabnineThree alternatives
Cursor, Sourcegraph Cody, TabnineFour alternatives
Amazon Q Developer, Claude Code, Tabnine, Windsurf – Devin DesktopThree alternatives
Amazon Q Developer, Cline, WindsurfBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:19 | no | 0 | 5 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 16:05 | yes | 5 | 8 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 14:38 | no | 0 | 18 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 08:41 | yes | 10 | 4 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 17:12 | yes | 5 | 8 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 17:47 | yes | 5 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 08:42 | yes | 25 | 34 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 17:51 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 18:50 | yes | 5 | 15 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 11:43 | yes | 15 | 18 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 14:56 | yes | 25 | 29 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 13:43 | yes | 5 | 23 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 13:31 | yes | 3 | 14 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 17:20 | yes | 15 | 15 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 14:59 | yes | 20 | 9 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 11:38 | yes | 3 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 18:03 | no | 0 | 17 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 12:41 | yes | 10 | 3 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 15:52 | yes | 5 | 9 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 15:28 | yes | 5 | 3 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 15:32 | yes | 25 | 35 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 12:58 | yes | 5 | 3 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 16:44 | no | 0 | 27 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 18:06 | yes | 24 | 25 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 13:43 | yes | 10 | 14 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:15 | no | 0 | 14 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 11:11 | yes | 3 | 12 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 12:37 | yes | 15 | 17 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:11 | yes | 9 | 7 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 16:23 | yes | 5 | 7 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 18:33 | yes | 12 | 27 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 11:35 | yes | 10 | 7 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 18:36 | yes | 5 | 13 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 13:26 | yes | 5 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:43 | yes | 25 | 35 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 16:58 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 09:54 | yes | 5 | 18 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 19:37 | yes | 5 | 15 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 09:08 | yes | 20 | 72 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 09:37 | yes | 15 | 41 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 15:30 | yes | 6 | 22 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 18:30 | yes | 13 | 21 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 10:54 | no | 0 | 5 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 11:06 | yes | 3 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 10:06 | yes | 17 | 23 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 17:25 | yes | 10 | 3 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 14:59 | yes | 5 | 9 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 10:36 | yes | 5 | 3 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 11:20 | yes | 25 | 20 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 10:10 | yes | 5 | 3 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 18:52 | yes | 14 | 50 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 18:16 | yes | 14 | 41 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 19:02 | yes | 10 | 48 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 09:01 | no | 0 | 32 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 15:57 | yes | 2 | 15 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 15:09 | yes | 14 | 20 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 15:48 | no | 0 | 8 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 11:44 | no | 0 | 6 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 11:08 | no | 0 | 19 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 08:51 | yes | 10 | 7 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:54 | yes | 5 | 13 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 12:23 | no | 0 | 5 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 11:22 | yes | 23 | 39 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:06 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 14:51 | no | 0 | 28 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 17:31 | yes | 24 | 40 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:26 | yes | 15 | 62 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 19:40 | no | 0 | 10 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 08:58 | yes | 2 | 14 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 16:40 | yes | 15 | 27 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:10 | yes | 19 | 11 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 10:45 | yes | 3 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 10:47 | yes | 11 | 21 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 13:10 | yes | 10 | 4 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:44 | yes | 9 | 14 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 18:10 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 18:09 | yes | 24 | 34 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 16:55 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 10:55 | yes | 21 | 44 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 14:02 | yes | 25 | 32 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 10:35 | yes | 24 | 44 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 17:06 | yes | 10 | 34 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 14:48 | yes | 4 | 19 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 18:54 | yes | 14 | 22 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
AWS Q read as Amazon Q Developer
Amazon Q read as Amazon Q Developer
Copilot read as GitHub Copilot
Copilot Free read as GitHub Copilot
JetBrains AI read as JetBrains AI Assistant
Unresolved, counted raw
AI Dev Helper
AskCodi
AutoCoder 3000
Builder.ai
CodeBuddy
CodeGeeX
CodeGen Pro
Copilot Autofix
GitHub Copilot Business or Enterprise
GitHub Copilot Workspace
IntelliAssist
Jules
Kite
MutableAI
OpenAI ChatGPT/GPT models
OpenCode Go
Phind
Playcode AI
QuickScript
SmartCode AI
Windsurf – Devin Desktop
Windsurf, formerly Codeium
monday agents
Discontinued, still offered
No shut-down product was recommended here.