How we test & rank
Every ranking on MSP Compared is computed from real, sourced data — not paid placement and not unverifiable opinion. Here's exactly how.
The data behind every page
- Pricing — published vendor list prices, captured with a date and source link, and re-checked weekly by an automated pricing monitor. Quote-only tools are labeled as such; we never invent a number.
- Independent ratings — aggregate star scores and review volumes from G2 and Capterra. Review counts are rounded snapshots (shown with a "~") taken on the data-as-of date, not live counters — they move daily, so we treat them as approximate.
- Security posture — live CVE/KEV (CISA) and Microsoft Patch Tuesday feeds, surfaced where relevant.
- Features & fit — capability and deployment data from vendor documentation.
The score (0–10)
Every headline score is a transparent weighted composite — the same formula for every tool, recomputed whenever the data changes. No vendor can buy a higher score.
- 50% — Editorial assessment. Our hands-on/documentation judgement of the product. This is the one human input; the rest is mechanical.
- 30% — Independent reviews. G2/Capterra star ratings, weighted by review volume so a 4.7 from 1,000 reviews counts more than a 4.9 from 20.
- 12% — Feature breadth. How many capabilities we track for the tool, normalised to the broadest product in its set. This rewards coverage, not quality — read the per-tool notes for nuance.
- 8% — Trial access. Whether there's a free tier or free trial to de-risk evaluation.
Recognitions & distinctions
Some products earn a badge on their profile and in category rankings. Like the score, every badge is computed mechanically from the same data and is scoped to a product's primary category — never sold. To qualify for a top distinction a product needs at least 50 independent reviews, so a thinly-reviewed tool can't leapfrog an established one:
- Editor's Choice — the highest overall data-weighted score in its category.
- Top Rated — the highest independent star rating in its category (minimum 4.5/5).
- Most Adopted — the most-reviewed product in its category (our proxy for market adoption).
- Best Value — an above-median score at a bottom-tier entry price (or a free tier).
The comparison spider chart
On comparison pages we break the score into six 0–10 axes so you can audit it: Editorial, User reviews, Adoption (review volume as a popularity proxy), Affordability (published starting-price position — this measures price, not value-for-money), Feature breadth, and Ease of trial. The accompanying table shows the exact number behind every axis.
Hands-on testing
Where we have trialed a tool, we add first-hand setup, UX and support notes and a last_tested date. We're expanding hands-on coverage across the 190 tools and 26 categories we track; data-backed rankings ship first, hands-on notes follow.
Independence & disclosure
We earn affiliate commissions when you sign up through some links. This never affects rankings or scores — see our terms & affiliate disclosure.