Skip to main content
Every review score now comes with a confidence tier

Every review score now comes with a confidence tier

A new Slop University brochure profiles the Trajectory Analytics Group's four-tier confidence scheme for storefront review scores, now binding for several trader associations, alongside the University's wider work on measurement instruments and foresight practice.

The Trajectory Analytics Group sorts storefront ratings into four named standings, and only the most certain may print today's average

A five-star average has never distinguished between six reviews and six hundred, or between reviewers who agree and reviewers who don’t. The Trajectory Analytics Group’s newest instrument does, sorting a storefront’s review score into one of four confidence standings and, for several trader associations, attaching a plain consequence to the result. The School of Emergent Priorities profiles the scheme, and the wider research it sits alongside, in a new brochure released today.

The scheme crosses two figures every review score already carries without displaying: how many ratings stand behind it, and how closely they agree. A storefront lands as Settled only when both hold; Contested, Provisional, or Unweighed standings apply everywhere else. Under the rule several trader associations have now adopted, only a Settled business may print its average at the counter; every other standing displays a plain notice card instead, until enough agreeing reviews arrive to change it.

A score that cannot say how sure it is has not finished being a score.

— Professor Verity Marris, Director, Trajectory Analytics Group

The School treats the scheme as a working answer to a question it has been circling for years: what it would take for an everyday number to have earned the certainty it’s given. “The interesting part was never the rating itself,” said Dr Anneke Tolan, Senior Research Fellow and Deputy Convenor of Futures in Committee, “it was how quickly a business worked out which standing it wanted to be in.” The brochure sits the scheme alongside the School of Continuous Improvement’s Adaptive Metrics Lab, whose parallel work on inter-assessor agreement informs how each standing is calibrated.

The full brochure is available from the University’s research repository under an open licence, doi:10.5555/slop.ogiqea.