Seven of fourteen models named Codility first on the direct prompt; two named CodeSignal. Both were named by all fourteen models and Codility carries 58 labels and CodeSignal 57, so the shares are not directly comparable.
Named in four categories this edition.
Named in three categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the technical hiring assessments page.
Across every category in the November 2026 Edition, Codility and CodeSignal were named in the same answer 145 times, of the 251 answers naming Codility and the 194 naming CodeSignal. In those answers CodeSignal took the first choice fourteen times and Codility twenty-eight.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of six in this category shown.
“Why Avoid the Giants? (HackerRank & Codility) ... often poor choices for *strictly* limited budgets” Qwen 3.7 Flash · budget prompt · hard negative
“While these are industry standards, they carry specific complaints regarding *usability* and *relevance* rather than malice.” Qwen 3.7 Flash · negative prompt · soft negative
“significantly cheaper than enterprise-focused platforms like HackerRank or Codility (which start around $1,200+/year)” Kimi K2 · budget prompt · soft negative
“Codility | Defensible hiring decisions; agentic AI coding | ~$1,200/yr (120 credits) | Strongest proctoring, VS Code env, Claude Code integration” DeepSeek V4 Flash · scale prompt · first choice
“Choose Codility if you need defensible, custom work-sample assessments, strong compliance/auditability and explicit coding-agent support.” Muse Glimmer 30B · comparative prompt · first choice
“For most mid-market B2B companies, Codility offers the best balance of assessment quality, pricing, and defensibility.” MiniMax M2.5 · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Users have reported numerous bugs, system refreshes that lost their code, and random language switches during assessments” Claude Haiku 4.5 · negative prompt · hard negative
“Frequent candidate complaints about glitches in the editor... Trustpilot averages around 3/5, with reports of lost work during timed tests.” Grok 4.20 · negative prompt · soft negative
“CodeSignal assessments requiring proctoring: Be aware that a proctored assessment may record your camera, microphone, and screen” GPT-6 Luna · negative prompt · soft negative
“Offers a free plan and is highly ranked for technical hiring... This is a strong choice if you need a robust, all-in-one solution without immediate cost.” Mistral Small · budget prompt · first choice
“Highly ranked for its broad assessment suite, analytics, proctoring, and integrations, making it a strong all-around choice” Mistral Small · direct prompt · first choice
“Choose CodeSignal for standardized assessments, certification, structured scoring, or high-volume early-career hiring.” Perplexity Sonar · comparative prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.