Zero of fourteen models named Ramp first on the direct prompt; one named AvidXchange. Both were named by all fourteen models and both carry 41 labels, so the shares below are directly comparable.
Named in sixteen categories this edition.
Named in eleven categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the accounts payable automation page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.20 | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. One of one in this category shown.
“standalone consumer-grade payment apps (like early-stage versions of Ramp or Mercury Bill Pay) for large enterprises” Qwen 3.7 Flash · negative prompt · hard negative
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of six in this category shown.
“AvidXchange has reported issues including the need to call or email to request stop payments, files that are too large to upload, and random queues from indexer bots” Claude Haiku 4.5 · negative prompt · soft negative
“Older enterprise-heavy platforms like Basware or AvidXchange ... often suffer from long implementation times” Qwen 3.7 Flash · negative prompt · soft negative
“Mentioned in similar Reddit threads as risky for implementations that "almost got CFOs fired"” Grok 4.20 · negative prompt · soft negative
“The best accounts payable automation software for a mid-market B2B company is AvidXchange.” Llama 4 Maverick · direct prompt · first choice
“Best Overall for Mid-Market Complexity: AvidXchange” Qwen 3.7 Flash · paraphrase prompt · first choice
“AvidXchange — Best for mid-market invoice automation.” Muse Glimmer 30B · paraphrase prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.