Port vs Roadie
Ten of fourteen models named Port first on the direct prompt; one named Roadie. Port was named by fourteen of the fourteen models and Roadie by thirteen and Port carries 71 labels and Roadie 32, so the shares are not directly comparable.
Named in two categories this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the internal developer portals page.
By framing
PortFirst choices, of fourteen modelsRoadie
Across every category in the November 2026 Edition, Port and Roadie were named in the same answer ninety-eight times, of the 215 answers naming Port and the 103 naming Roadie. In those answers Roadie took the first choice eight times and Port forty-eight.
Every model, every framing
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | | | ||||
| GPT-5.4 mini | | | | | ||
| Gemini 3.5 Flash | | | | | | |
| Perplexity Sonar | | | | | ||
| Grok 4.20 | | | | | | |
| Mistral Small | | | | | | |
| DeepSeek V4 Flash | | | | | | |
| Llama 4 Maverick | | | | | ||
| Qwen 3.7 Flash | | | | |||
| Kimi K2 | | | | | | |
| GLM 4.7 FlashX | | | | | | |
| MiniMax M2.5 | | | | | ||
| GPT-6 Luna | | | | | | |
| Muse Glimmer 30B | | | | |
Port Roadie first choice named as an alternative argued againstblank: not namedEach cell is one answer, Port on the left and Roadie on the right.The direct prompt
Port first, Roadie an alternative
10 of 14 modelsRoadie was named in the answer but not as the choice, or not at all.Roadie first, Port an alternative
1 of 14 modelsPort was named in the answer but not as the choice, or not at all.Neither was the first choice, one was named
2 of 14 modelsThe answer put something else first and named one of the two as an alternative.Neither was named
1 of 14 modelsThe answer made no first choice from these two in this category.Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
By buyer segment
What the models said about Port
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Proprietary Closed‑Source Portals (e.g., Port.io, OpsLevel, Atlassian Compass) | *Vendor lock‑in.*” GLM 4.7 FlashX · negative prompt · soft negative
“you should carefully verify Port's compatibility with your infrastructure before committing fully” Mistral Small · negative prompt · soft negative
“proprietary portals (Port.io, OpsLevel, Atlassian Compass, etc.) carry vendor lock-in risks” Mistral Small · negative prompt · soft negative
“Port — Best Overall Value for Small-to-Mid Teams ... Port's free tier (up to 15 users) is the sweet spot between capability and cost.” Kimi K2 · budget prompt · first choice
“Port is recommended for mid-sized B2B companies as it provides a good balance of time-to-value, governance, and mid-market pricing.” Llama 4 Maverick · paraphrase prompt · first choice
“Choose Port for balanced, quick-start portals with modern features like AI—often recommended as the "best for most teams"” Grok 4.20 · comparative prompt · first choice
What the models said about Roadie
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of four in this category shown.
“starting with a SaaS catalog-first portal like Port or Roadie gives the quickest developer experience lift” Muse Glimmer 30B · paraphrase prompt · first choice
“Need speed and developer experience? Port or Roadie.” Mistral Small · comparative prompt · first choice
“I'd recommend Roadie for a mid-sized B2B company” GLM 4.7 FlashX · paraphrase prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.