Technical hiring assessments for small business buyers
Asked as “coding assessment platform”, and as “technical interview tool”, on behalf of a small B2B company. 53 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
36%
Contested · CoderPad 11%
36Coderbyte11CoderPad08HackerRank45others
36% of first choices, contested.
Since October 2026▲+14Since October 2026: 22% → 36%, +14 points. Past the 13-point floor: movement.Coderbyte held the lead, +14 points on 22%, past the floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Coderbyte36%Contested▲+14Since October 2026: 22% → 36%, +14 points. Past the 13-point floor: movement.This pageMid-market
HackerRank23%Contested▲+6Since October 2026: 17% → 23%, +6 points. Inside the 13-point floor: within noise.Standing →EnterpriseHackerRank38%Contested▼−13Since October 2026: 51% → 38%, −13 points. Inside the 13-point floor: within noise.Standing →
Coderbyte36%Contested▲+14Since October 2026: 22% → 36%, +14 points. Past the 13-point floor: movement.This pageMid-marketHackerRank23%Contested▲+6Since October 2026: 17% → 23%, +6 points. Inside the 13-point floor: within noise.Standing →EnterpriseHackerRank38%Contested▼−13Since October 2026: 51% → 38%, −13 points. Inside the 13-point floor: within noise.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a small B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince October 2026
01Coderbyte36%4%47endorsed leader▲+14Since October 2026: 22% → 36%, +14 points. Past the 13-point floor: movement.22% → 36%
Coderbyte36%4%47endorsed leader▲+14Since October 2026: 22% → 36%, +14 points. Past the 13-point floor: movement.22% → 36%02
CoderPad11%17%36accepted challenger▼−6Since October 2026: 17% → 11%, −6 points. Inside the 13-point floor: within noise.17% → 11%
CoderPad11%17%36accepted challenger▼−6Since October 2026: 17% → 11%, −6 points. Inside the 13-point floor: within noise.17% → 11%03HackerRank8%45%55criticized challenger▼−4Since October 2026: 12% → 8%, −4 points. Inside the 13-point floor: within noise.12% → 8%
HackerRank8%45%55criticized challenger▼−4Since October 2026: 12% → 8%, −4 points. Inside the 13-point floor: within noise.12% → 8%04
TestGorilla6%20%51accepted challenger▼−8Since October 2026: 14% → 6%, −8 points. Inside the 13-point floor: within noise.14% → 6%
TestGorilla6%20%51accepted challenger▼−8Since October 2026: 14% → 6%, −8 points. Inside the 13-point floor: within noise.14% → 6%05
TestDome6%9%22accepted challenger▲+3Since October 2026: 3% → 6%, +3 points. Inside the 13-point floor: within noise.3% → 6%
TestDome6%9%22accepted challenger▲+3Since October 2026: 3% → 6%, +3 points. Inside the 13-point floor: within noise.3% → 6%06
Codility4%26%42criticized challenger▲+1Since October 2026: 3% → 4%, +1 point. Inside the 13-point floor: within noise.3% → 4%
Codility4%26%42criticized challenger▲+1Since October 2026: 3% → 4%, +1 point. Inside the 13-point floor: within noise.3% → 4%07
CodeSignal2%24%42accepted challenger▼−3Since October 2026: 5% → 2%, −3 points. Inside the 13-point floor: within noise.5% → 2%
CodeSignal2%24%42accepted challenger▼−3Since October 2026: 5% → 2%, −3 points. Inside the 13-point floor: within noise.5% → 2%08
Adaface2%0%12accepted challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 13-point floor: within noise.2% → 2%
Adaface2%0%12accepted challenger=heldSince October 2026: 2% → 2%, ±0 points. Inside the 13-point floor: within noise.2% → 2%Show the one product at 0%, ordered by negative rate
09
Testlify0%18%11accepted challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 13-point floor: within noise.2% → 0%
Testlify0%18%11accepted challenger▼−2Since October 2026: 2% → 0%, −2 points. Inside the 13-point floor: within noise.2% → 0%The floor is 13 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one can't be told apart from repeat variation, and both are shown. Each index measures its own floor from its own repeat, over its own categories, so the floor differs from one index to the next. Both editions asked the same fourteen models. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Head to headHead-to-head pages are published for mid-market buyers, so these open on mid-market figures, not small business.
All twenty-one head-to-head pages: the top seven products, each against each
HackerRank vs CoderPadHackerRank vs TestDomeHackerRank vs TestGorillaCodility vs CoderbyteCodility vs CodeSignalCodility vs CoderPadCodility vs TestDomeCodility vs TestGorillaCoderbyte vs CodeSignalCoderbyte vs CoderPadCoderbyte vs TestDomeCoderbyte vs TestGorillaCodeSignal vs CoderPadCodeSignal vs TestDomeCodeSignal vs TestGorillaCoderPad vs TestDomeCoderPad vs TestGorillaTestDome vs TestGorilla
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
010203040506070809Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01Coderbyte36%
Coderbyte36%02CoderPad11%
CoderPad11%03HackerRank8%
HackerRank8%04TestGorilla6%
TestGorilla6%05TestDome6%
TestDome6%06Codility4%
Codility4%07CodeSignal2%
CodeSignal2%08Adaface2%
Adaface2%09Testlify0%
Testlify0%What they warned about
Four of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.20, Mistral Small, DeepSeek V4 Flash, Kimi K2, GLM 4.7 FlashX and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
HackerRank45%
25 of 55 labels negative · 11 of 14 models · 3 hard negative
“Verdict for small business: Avoid unless you are recruiting specifically for competitive programming or algorithm-heavy roles” DeepSeek V4 Flash, negative prompt
TestGorilla20%
10 of 51 labels negative · 10 of 14 models · 3 hard negative
“small businesses should be cautious about or avoid the following technical assessment platforms: 1. TestGorilla – Multiple reviews highlight issues such as expensive contracts” Mistral Small, negative prompt
Codility26%
11 of 42 labels negative · 7 of 14 models · 2 hard negative
“Avoid big players like Codility unless you can get a steep startup discount” Grok 4.20, budget prompt
Mercer | Mettl100%
9 of 9 labels negative · 6 of 14 models · 5 hard negative
“Avoid enterprise-grade suites. Look for pay-per-test or small-package tools instead.” DeepSeek V4 Flash, negative prompt
What they cite
Fourteen of the fourteen models returned a source list in this edition: five return the pages they cited and nine the search results they consulted.
Sites the answers cite
75 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 833 links across 176 sites, every framing counted. Ranked by the number of answers carrying the site or page. 16 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · Coderbyte39 answers · 60 citations · 11 models
vendor site · Codility36 answers · 62 citations · 12 models
vendor site · G229 answers · 63 citations · 12 models
vendor site · CodeSignal24 answers · 25 citations · 13 models
24 answers · 25 citations · 10 models
vendor site · HackerRank23 answers · 34 citations · 11 models
vendor site · TestTrick22 answers · 27 citations · 11 models
vendor site · Adaface21 answers · 24 citations · 9 models
21 answers · 22 citations · 9 models
16 answers · 37 citations · 9 models
vendor site · AmazingHiring16 answers · 16 citations · 8 models
15 answers · 18 citations · 10 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
36 answers · 9 models
22 answers · 9 models
18 answers · 8 models
16 answers · 8 models
15 answers · 8 models
15 answers · 7 models
15 answers · 8 models
12 answers · 7 models
12 answers · 10 models
12 answers · 11 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best coding assessment platform”, “coding assessment platform”, “technical assessment platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Coderbyte coderbyte.com | 36% | 125 | 2,400 | 60 | 2,019 | 93 | ||
| CoderPad coderpad.io | 11% | 95 | 18,100 | 269 | 34,657 | 9 | 2 | |
| HackerRank hackerrank.com | 8% | 278 | 33,100 | 1,116 | 58,699 | 22 | 4 | |
| TestGorilla testgorilla.com | 6% | 254 | 4,400 | 170 | 58,548 | $462 | 76 | |
| TestDome testdome.com | 6% | 53 | 880 | 22 | 34,709 | 0 | ||
| Playcode playcode.io | 6% | 8 | 2,400 | 11 | 49,112 | |||
| Codility codility.com | 4% | 235 | 3,600 | 114 | 3,042 | $108 | 3 | |
| Equip equip.co | 4% | 15 | ||||||
| CodeSignal codesignal.com | 2% | 179 | 14,800 | 548 | 152,420 | $5,323 | 23 | 9 |
| Adaface adaface.com | 2% | 24 | 260 | 2 | 20,658 |
Google's top ten for the three searches hold 20 sites; 3 of them are among the sites the models cited here (amazinghiring.com, codesignal.com, hackerrank.com). The first result for “best coding assessment platform” is algocademy.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best coding assessment platform for a small B2B company?”Paraphrase“Which technical interview tool would you recommend to a small business that sells to other businesses?”Comparative“What are the top technical assessment platforms for a small team and how do they differ?”Budget-constrained“What is the best coding assessment platform for a small company with a tight budget?”Scale-constrained“We are a 30 person company evaluating a coding assessment platform. What should we look at?”Negative“Which technical assessment platforms should a small business avoid or be cautious about?”
Claude Haiku 4.5no first choiceSpark HireChangedCoderPad, TestDomeagainst: HackerEarth Assessments, HackerRankCoderbyte, Playcodeno first choiceagainst: CodeSignal, CoderPad, HackerRank, Mercer | Mettl
Three alternatives
1Way Interview, CodeBunk, CoderPadOne alternative
TestGorillaFour alternatives
HackerEarth Assessments, LeetCode, TestDome, TestGorillaGPT-5.4 miniCoderbyte, CodilityCodeSignal Hire BuildChangedCodeSignal, CoderPadagainst: HackerRankCoderbyteno first choiceagainst: Coderbyte, HackerEarth Assessments, Mercer Mettl Assessments, TestDome, TestGorilla, Testlify
Two alternatives
CodeSignal, HackerRankTwo alternatives
CodeSession, Interviewing.ioFive alternatives
Coderbyte, Codility, HackerEarth Assessments, TestDome, TestGorillaThree alternatives
CodeSignal, HackerRank, TestGorillaGemini 3.5 FlashCoderbyteagainst: CodeSignal, Codility, HackerRankCoderPadChangedCoderbyteagainst: CodeSignal, HackerRankCodeSubmit, CoderbyteCoderbyteagainst: CodeSignal, HackerRankagainst: CodeSignal, Codility, HackerRank, Karat, Mercer | Mettl, TestGorilla
Three alternatives
Adaface, CodeSubmit, TestGorillaThree alternatives
CodeSubmit, Coderbyte, TestGorillaFour alternatives
CodeSubmit, CoderPad, TestDome, TestGorillaThree alternatives
Adaface, GitHub, TestGorillaThree alternatives
CodeSubmit, CoderPad, TestGorillaPerplexity SonarCoderbyteagainst: HackerRankCoderPadChangedagainst: HackerRank, HireflixTestDome, TestGorillaagainst: HackerRankTestDomeagainst: HackerRankno first choiceagainst: TestDome
Two alternatives
TestDome, TestGorillaOne alternative
JobmaFour alternatives
CodeSignal, CoderPad, Coderbyte, CodilityFour alternatives
CoderPad, Coderbyte, Equip, TestTrickGrok 4.20Coderbyte, TestGorillaagainst: Codility, HackerEarth Assessments, HackerRank, LeetCode, Mercer | MettlHackerRankChangedagainst: Codility, KaratCodeSignal, HackerRankTestDomeagainst: CodeSignal, Codility, HackerRankCoderbyteagainst: HackerRank, Mercer | Mettlagainst: CoderPad, HackerRank, Mercer | Mettl
Three alternatives
CoderPad, Intervue, iMochaThree alternatives
Codility, DevSkiller, TestGorillaThree alternatives
Adaface, Coderbyte, SkillfuelFour alternatives
CodeSignal, Codility, DevSkiller, TestGorillaMistral SmallCoderbyteCodility, TestGorillaChangedTestGorillaagainst: DucknowlCoderbyte, TestDomeno first choiceagainst: Andela, AssessTEAM, TestGorilla
Three alternatives
CoderPad, Codility, TestGorillaSix alternatives
CodeSignal, CoderPad, Coderbyte, Evalart, HackerRank, TestlifyTwo alternatives
CoderPad, HackerRankDeepSeek V4 FlashTestGorillaCoderbyteChangedHackerRankGoodfitno first choiceagainst: Codility, Glider.ai, HackerRank, LeetCode, Mercer | Mettl, TestGorilla, WeCP
Four alternatives
CodeSignal, CoderPad, HackerRank, TestDomeOne alternative
TestGorillaThree alternatives
CodeSignal, Coderbyte, CodilityTwo alternatives
HackerRank, TestGorillaLlama 4 Maverickno first choiceno first choiceHeldCodility, WeCPPlaycodeno first choiceagainst: TestGorilla, Testlify
Four alternatives
CodeSignal, DevSkiller, TestGorilla, TestTrickThree alternatives
CoderPad, HackerEarth Assessments, VS Code Live ShareQwen 3.7 FlashCoderPadagainst: CodeCompetitive, HackerRank, Mercer | Mettl, MercorCoderPadHeldagainst: HackerRankCodeSignal, HackerRank, TestGorillaCodeSignalagainst: Ducknowl, TestTrickCoderPadagainst: Coderbyte, DevSkiller, Glider.ai, Mercer | Mettl, TestGorilla, iMocha
Three alternatives
CodeSignal, Glidar AI, TestGorillaTwo alternatives
CodeSignal, TestGorillaTwo alternatives
Adaface, TestlifyTwo alternatives
Coderbyte, HackerRankThree alternatives
Adaface, CodeSignal, CodilityKimi K2Adaface, CoderbyteCoderbyteChangedCoderbyte, TestGorillaagainst: CodeSignal, HackerRankCodeInterview, VS Code Live Shareno first choiceagainst: Geektastic, HackerRank, Kryterion Webassessor, Mercer | Mettl, ProctorU, Prometric, TestGorilla, iMocha
Three alternatives
CodeSignal, Codility, HackerRankThree alternatives
CoderPad, Hirevire, TestGorillaOne alternative
CodilityFour alternatives
ASTRNT, Coderbyte, Equip, TestTrickGLM 4.7 FlashXCoderbyteagainst: CoderPad, HackerRankHackerRankChangedagainst: CodilityTestlifyPlaycodeagainst: CodeSignal, CoderPad, Codility, DevSkiller, HackerRankno first choiceagainst: ACCELQ Autopilot, BrowserStack, HackerEarth Assessments, Mabl, Postman, Selenium, Testim, Testsigma, TryMyUI, UserTesting
Three alternatives
CodeSignal, Codility, TestlifyTwo alternatives
Hirevire, TestGorillaSeven alternatives
Adaface, CodeSignal, Codility, HackerRank, TestDome, TestGorilla, VervoeFour alternatives
Adaface, Goodfit, HackerEarth Assessments, TestGorillaMiniMax M2.5CoderbyteCoderbyteHeldCoderbyteEquipno first choiceagainst: Codility, HackerRank, TestGorilla
Three alternatives
ASTRNT, CoderPad, TestDomeThree alternatives
Breezy HR, Codility, TestGorillaThree alternatives
Codility, HackerRank, TestGorillaTwo alternatives
ASTRNT, EvalartGPT-6 LunaHackerRankHackerRankHeldCodeSignal, HackerRankagainst: CodilityCoderScreenagainst: CodeSignal, HackerRankCoderPadagainst: CodeSignal, HackerRank, TestGorilla
One alternative
CodeSignal BuildOne alternative
CoderPadOne alternative
TestGorillaOne alternative
TestDomeThree alternatives
CodeSignal, HackerRank, TestGorillaMuse Glimmer 30BASTRNT, Coderbyte, EquipCoderbyteChangedagainst: CoderPadCodilityTestTrickno first choiceagainst: CoderPad, Codility, TestGorilla
Four alternatives
Criteria Corp, Evalart, TestDome, TestGorillaTwo alternatives
Breezy HR, HirevireSix alternatives
CodeSignal, CoderPad, Coderbyte, Equip, HackerRank, TestGorillaThree alternatives
ASTRNT, Equip, PlaycodeBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency.
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 12:55 | no | 0 | 3 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 11:29 | yes | 1 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 12:42 | yes | 13 | 27 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-11-01 10:32 | yes | 10 | 3 s |
| Direct recommendation | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:23 | yes | 5 | 32 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 10:16 | yes | 5 | 3 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 12:52 | yes | 22 | 22 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:42 | yes | 5 | 8 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 12:34 | yes | 5 | 20 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 09:11 | yes | 5 | 13 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 09:44 | yes | 19 | 232 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:30 | yes | 12 | 31 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-11-01 09:53 | yes | 2 | 11 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 09:54 | yes | 13 | 24 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:32 | yes | 10 | 8 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 09:51 | yes | 3 | 6 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 11:53 | no | 0 | 14 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-11-01 12:03 | yes | 10 | 3 s |
| Paraphrase | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:18 | yes | 5 | 28 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 09:26 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 12:40 | yes | 24 | 25 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:23 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 09:14 | no | 0 | 23 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 10:00 | yes | 10 | 32 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 08:57 | yes | 14 | 33 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 11:26 | yes | 10 | 41 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-11-01 10:07 | yes | 2 | 9 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 10:56 | yes | 13 | 18 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:31 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 09:56 | yes | 4 | 7 s |
| Comparative | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 08:40 | yes | 12 | 25 s |
| Comparative | Perplexity Sonar | sonar | 2026-11-01 08:43 | yes | 10 | 5 s |
| Comparative | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:12 | yes | 13 | 33 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 08:54 | yes | 5 | 6 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 11:49 | yes | 19 | 33 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:12 | yes | 5 | 3 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 11:56 | yes | 9 | 25 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 11:46 | yes | 25 | 28 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:52 | yes | 23 | 138 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 11:06 | yes | 10 | 25 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-11-01 10:08 | yes | 4 | 20 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 09:17 | yes | 13 | 35 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 09:36 | yes | 10 | 8 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 09:21 | yes | 4 | 11 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 09:27 | no | 0 | 12 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-11-01 12:08 | yes | 10 | 3 s |
| Budget constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:05 | yes | 5 | 31 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 09:06 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:47 | yes | 24 | 20 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 09:43 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 11:56 | yes | 5 | 29 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 11:59 | yes | 9 | 24 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 12:30 | yes | 14 | 90 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 10:31 | yes | 19 | 38 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 11:41 | yes | 3 | 10 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 09:13 | yes | 13 | 18 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 10:23 | no | 0 | 5 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 10:54 | no | 0 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 09:09 | yes | 14 | 22 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-11-01 12:58 | yes | 10 | 6 s |
| Scale constrained | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:10 | yes | 15 | 36 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 12:53 | no | 0 | 5 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 11:50 | yes | 22 | 39 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:48 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 09:18 | yes | 5 | 41 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 12:27 | yes | 15 | 29 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:03 | yes | 10 | 56 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 11:27 | no | 0 | 77 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-11-01 08:53 | yes | 3 | 14 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 12:41 | yes | 13 | 21 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-11-01 11:17 | yes | 18 | 11 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-11-01 10:57 | yes | 5 | 5 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.6-flash (asked for gemini-3.5-flash; the API answered as this version) | 2026-11-01 12:45 | no | 0 | 17 s |
| Negative framing | Perplexity Sonar | sonar | 2026-11-01 09:20 | yes | 10 | 5 s |
| Negative framing | Grok 4.20 | spacexai/grok-4.20-non-reasoning via xai | 2026-11-01 13:32 | yes | 20 | 44 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-11-01 10:40 | yes | 5 | 4 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-11-01 10:52 | yes | 23 | 36 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-11-01 11:23 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-11-01 12:22 | yes | 25 | 100 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-11-01 12:26 | yes | 24 | 30 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-11-01 11:58 | yes | 25 | 89 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-11-01 09:51 | yes | 15 | 49 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-11-01 09:26 | yes | 6 | 20 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-11-01 11:39 | yes | 25 | 33 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
HackerEarth read as HackerEarth Assessments
Unresolved, counted raw
ACCELQ Autopilot
BrowserStack
BugBug
CodeBunk
CodeCompetitive
CodeSession
CodeSignal Hire Build
Cypress
Glidar AI
Kualitee
LambdaTest (TestMu AI)
Mabl
Mercer Mettl Assessments
Playwright
Postman
Qase
Selenium
Skillfuel
TestLink
Testim
Testiny
Testsigma
Toggl
TryMyUI
UserTesting
Discontinued, still offered
No shut-down product was recommended here.