Roadie vs Atlassian Compass
One of fourteen models named Roadie first on the direct prompt; zero named Atlassian Compass. Roadie was named by thirteen of the fourteen models and Atlassian Compass by fourteen and Roadie carries 32 labels and Atlassian Compass 30, so the shares are not directly comparable.
Named in one category this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the internal developer portals page.
By framing
RoadieFirst choices, of fourteen modelsAtlassian Compass
Across every category in the November 2026 Edition, Roadie and Atlassian Compass were named in the same answer fifty-one times, of the 103 answers naming Roadie and the 97 naming Atlassian Compass. In those answers Atlassian Compass took the first choice one time and Roadie three.
Every model, every framing
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | | | | | ||
| Gemini 3.5 Flash | | | | | | |
| Perplexity Sonar | | | | |||
| Grok 4.20 | | | | |||
| Mistral Small | | | | |||
| DeepSeek V4 Flash | | | | |||
| Llama 4 Maverick | | |||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | | | | |||
| GLM 4.7 FlashX | | | | |||
| MiniMax M2.5 | | | ||||
| GPT-6 Luna | | | ||||
| Muse Glimmer 30B | | | |
Roadie Atlassian Compass first choice named as an alternative argued againstblank: not namedEach cell is one answer, Roadie on the left and Atlassian Compass on the right.The direct prompt
Roadie first, Atlassian Compass not the choice
1 of 14 modelsAtlassian Compass was named in the answer but not as the choice, or not at all.Neither was the first choice, one was named
4 of 14 modelsThe answer put something else first and named one of the two as an alternative.Neither was named
9 of 14 modelsThe answer made no first choice from these two in this category.Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
By buyer segment
Atlassian Compass7%#3 of 7Roadie6%#4 of 7Roadie8%#4 of 8Atlassian Compass4%#5 of 8What the models said about Roadie
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of four in this category shown.
“starting with a SaaS catalog-first portal like Port or Roadie gives the quickest developer experience lift” Muse Glimmer 30B · paraphrase prompt · first choice
“Need speed and developer experience? Port or Roadie.” Mistral Small · comparative prompt · first choice
“I'd recommend Roadie for a mid-sized B2B company” GLM 4.7 FlashX · paraphrase prompt · first choice
What the models said about Atlassian Compass
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“I would not start a new evaluation with Atlassian Compass as a standalone option.” GPT-6 Luna · scale prompt · hard negative
“Avoid for new implementations — Atlassian is winding this down” Kimi K2 · negative prompt · hard negative
“Ecosystem-centric portals like Atlassian Compass... can lack the deep extensibility or custom integration freedom” Gemini 3.5 Flash · negative prompt · soft negative
“The best internal developer portal for a company with a limited budget is Atlassian Compass, which is a cheap per-user IDP at $8/user/mo” Llama 4 Maverick · budget prompt · first choice
“Atlassian Compass is usually the best paid choice” Perplexity Sonar · budget prompt · first choice
“If you're already using Atlassian tools, Compass is the most budget-friendly paid option.” Mistral Small · budget prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.