Thirteen of fourteen models named GitHub Copilot first on the direct prompt; zero named Cline. GitHub Copilot was named by fourteen of the fourteen models and Cline by eight and GitHub Copilot carries 80 labels and Cline 11, so the shares are not directly comparable.
Named in three categories this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the AI coding assistants page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“GitHub explicitly warns that Copilot CLI and cloud-agent workflows need extra caution around command execution, sensitive information, and inaccurate code.” GPT-5.4 mini · negative prompt · soft negative
“Highest visibility in risks—can memorize/leak real secrets, API keys, or training data snippets... consumer/free tiers are riskier.” Grok 4.20 · negative prompt · soft negative
“AI coding assistants like Copilot and Cursor introduce 45% vulnerability rates, secret leaks, and prompt injection risks in 2026.” Claude Haiku 4.5 · negative prompt · soft negative
“I'd suggest evaluating GitHub Copilot (strong industry adoption) and Claude (excellent for complex reasoning) as starting points” Claude Haiku 4.5 · direct prompt · first choice
“Start with GitHub Copilot if you're already on GitHub — it's the safest, most mature, and most widely adopted option” DeepSeek V4 Flash · direct prompt · first choice
“GitHub Copilot is widely considered the best all-around AI coding assistant for mid-market B2B companies.” Qwen 3.7 Flash · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of five in this category shown.
“Be cautious about these types of tools in sensitive environments... Tools like Cline” GLM 4.7 FlashX · negative prompt · soft negative
“Start by installing Cline (in VS Code) or Aider (in terminal)” Gemini 3.5 Flash · budget prompt · first choice
“Lowest-cost flexible option: Cline or Aider — The tools are free, but the company pays separately for model usage” Perplexity Sonar · budget prompt · alternative
“Winners: Cline / Aider + Open Source Models ... You install tools like Cline or Aider. These run locally.” Qwen 3.7 Flash · budget prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.