Zero of fourteen models named Shuffle first on the direct prompt; two named Swimlane Turbine. Shuffle was named by eleven of the fourteen models and Swimlane Turbine by thirteen and Shuffle carries 15 labels and Swimlane Turbine 44, so the shares are not directly comparable.
Named in one category this edition.
Named in two categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the SOAR platforms page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of four in this category shown.
“Top Pick: For most budget-constrained security teams, Shuffle offers the best balance of capability, active community support, and zero licensing fees.” Gemini 3.5 Flash · budget prompt · first choice
“For a company with a genuinely limited budget, Shuffle (self-hosted) or Tines Community Edition are the strongest starting points.” DeepSeek V4 Flash · budget prompt · first choice
“Best Open-Source/Free Options ... Shuffle ... fully open-source (GPLv3), lightweight, and features a visual workflow builder” Qwen 3.7 Flash · budget prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Noted for high negative sentiment, especially regarding cost and complexity for smaller organizations” Mistral Small · negative prompt · hard negative
“Complex setup... Stability issues... Support hours... Maintenance overhead” GLM 4.7 FlashX · negative prompt · soft negative
“Traditional enterprise SOAR. Powerful but can be heavy/expensive.” Qwen 3.7 Flash · scale prompt · soft negative
“Best overall ease of deployment for mid-size B2B with limited SOC engineering: Tines or Swimlane.” Muse Glimmer 30B · paraphrase prompt · first choice
“Platforms like Tines, Swimlane Turbine, or Torq offer modern visual workflow builders” Gemini 3.5 Flash · negative prompt · first choice
“Palo Alto Cortex XSOAR or Swimlane would be the top recommendations” MiniMax M2.5 · direct prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.