One of fourteen models named OWASP ZAP first on the direct prompt; one named Probely. OWASP ZAP was named by fourteen of the fourteen models and Probely by six and OWASP ZAP carries 57 labels and Probely 10, so the shares are not directly comparable.
Named in six categories this edition.
Named in two categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the dynamic application security testing page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of six in this category shown.
“it is advisable to avoid or proceed with extreme caution when using OWASP ZAP or Invicti in automated pipelines” Mistral Small · negative prompt · hard negative
“Avoid for Automated Pipelines: OWASP ZAP (if you lack a dedicated team to manage it).” Qwen 3.7 Flash · negative prompt · hard negative
“Unmanaged open-source tools (like raw OWASP ZAP) unless you have dedicated headcount” Gemini 3.5 Flash · direct prompt · hard negative
“Best default for a limited budget: ZAP by Checkmarx (formerly OWASP ZAP). It's free and open source” GPT-6 Luna · budget prompt · first choice
“Use OWASP ZAP (actively maintained, modern browser crawling support, strong CI/CD integration)” Gemini 3.5 Flash · negative prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of four in this category shown.
“Best Overall Value: Probely ... My top recommendation: Start with a trial of Probely or OWASP ZAP” GLM 4.7 FlashX · direct prompt · first choice
“Top-Rated Options (from 2023–2025 reviews): Probely, StackHawk, Rapid7 InsightAppSec” Grok 4.20 · negative prompt · alternative
“StackHawk or Probely — Developer-friendly, strong CI/CD focus.” Grok 4.20 · scale prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.