$ git diff main -- methodology.md
commit a1b2c3d - author: Oliver Wakefield-Smith - verified 21 Jun 2026
The site tracks 19 AI code review tools. Pricing is taken from each vendor's own pricing page and re-verified on the date in the magenta pin. Token math uses Claude Sonnet 4.5 list ratessrc. Quote-only vendors are listed but excluded from $/PR ranking. No accuracy score is invented.
@@ pricing sourcing @@rule 1
1+Every seat rate is taken from the vendor's own pricing page. Third-party blogs are not used as a primary source.
2+The pricing page URL and the verified date sit in the magenta pin next to the claim, on every page.
3-If a vendor publishes only a price range ("starting at X") we use X and label it "cheapest published" rather than "list".
4-Enterprise discount you negotiated with your rep is not in here. Add a haircut as you see fit.
@@ $/PR normalisation @@rule 2
1Flat per-seat: monthly = seat_rate * team_size. Per-PR derived as monthly / (PRs_per_wk * 4.33).
2Per-repo (Git AutoReview): we assume 1 repo per 10 devs as a portfolio mid-point. This will be wrong for monorepo teams (over-pays) and for microservice teams (under-pays). The calculator's LOC input lets you sanity-check.
3Per-PR token meter (Claude Code Review, any BYOK path): token_cost = LOC * 24 * $3/M + LOC * 2 * $15/M. 24 input tokens per LOC reflects PR diff context-window inflation; 2 output tokens per LOC reflects review-comment density. Both are deliberate over-estimates so the headline does not under-promise.
4Bundled (Copilot Code Review): $0 marginal if Copilot Business is already in the budget; full Business seat cost otherwise.
@@ quote-only handling @@rule 3
1+Launchable and Diffblue Cover are listed on /scorecard and the calculator with the label "quote-only".
2-We do NOT publish an inferred rate. No "assumed $50/dev/mo" or "typically $X".
3-Sister sites have been burned inferring rates from leaked deal sizes. We are not doing that.
@@ accuracy / quality benchmarks @@rule 4
1OpenSSF Security Baseline and SWE-bench are referenced as the only third-party benchmarks worth pointing atsrcsrc.
2-We do not roll them into a single "accuracy score". Numbers move per release; a snapshot rank misleads.
3-Vendor-published benchmarks (every vendor has them, every vendor wins their own) are quoted on the per-tool page with the vendor labelled as the source. Reader can discount accordingly.
@@ refresh cadence @@rule 5
1Pricing pages get re-verified on a rolling 60-day cadence. The date in each magenta pin is the actual last check, not the page build date.
2/thread is the live log of changes that triggered an out-of-cadence refresh (Claude Code Review launch, Copilot AI Credits, Cursor BugBot $40 add-on, Macroscope v3 reprice).
@@ what we deliberately do NOT do @@opinion
1-No affiliate links. Sister sites carry them; this one does not, because vendor-paid placement would compromise the ranking it exists to publish.
2-No "Editor's Choice" badge. The ranking IS the opinion.
3-No social-proof testimonial blocks. The buyer is a Staff+ engineer who does not believe quote walls.
@@ cross-links @@related
1/sources - every cited URL with last-verified date
2/about - who runs this and on whose budget
3/faq - the 14 priority questions