Thirteen of fourteen models named GitHub Copilot first on the direct prompt; zero named Aider. GitHub Copilot was named by fourteen of the fourteen models and Aider by nine and GitHub Copilot carries 80 labels and Aider 14, so the shares are not directly comparable.
Named in three categories this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the AI coding assistants page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“GitHub explicitly warns that Copilot CLI and cloud-agent workflows need extra caution around command execution, sensitive information, and inaccurate code.” GPT-5.4 mini · negative prompt · soft negative
“Highest visibility in risks—can memorize/leak real secrets, API keys, or training data snippets... consumer/free tiers are riskier.” Grok 4.20 · negative prompt · soft negative
“AI coding assistants like Copilot and Cursor introduce 45% vulnerability rates, secret leaks, and prompt injection risks in 2026.” Claude Haiku 4.5 · negative prompt · soft negative
“I'd suggest evaluating GitHub Copilot (strong industry adoption) and Claude (excellent for complex reasoning) as starting points” Claude Haiku 4.5 · direct prompt · first choice
“Start with GitHub Copilot if you're already on GitHub — it's the safest, most mature, and most widely adopted option” DeepSeek V4 Flash · direct prompt · first choice
“GitHub Copilot is widely considered the best all-around AI coding assistant for mid-market B2B companies.” Qwen 3.7 Flash · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of five in this category shown.
“Be particularly cautious with: Autonomous agent modes in tools such as Claude Code, Cursor, Codex, Aider, Devin, and Copilot Workspace” Perplexity Sonar · negative prompt · soft negative
“Start by installing Cline (in VS Code) or Aider (in terminal)” Gemini 3.5 Flash · budget prompt · first choice
“A free, open-source tool that is also vendor-independent and allows you to bring your own API key.” Llama 4 Maverick · budget prompt · alternative
“Best for: Terminal-centric developers who want lightweight, transparent AI assistance” DeepSeek V4 Flash · comparative prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.