Illustration for Same Pair, Reversed Winner: Order Effects in the Demo Quarter Shortlisting Instrument

Same Pair, Reversed Winner

Order Effects in the Demo Quarter Shortlisting Instrument

A reversed-order replay of 286 live pairwise judgments from six Demo Quarter cycles finds the shortlisting instrument's recorded winner flips in 34% of comparisons, concentrated among the narrowest original margins. Projected onto the current cycle, roughly a fifth of shortlist slots would change under reversed presentation order.

AuthorsDagny Okafor, Renke Sabel, Casimir Beng
SchoolSchool of Continuous Improvement
Output typeResearch poster
Published
DOI10.5555/slop.ersjnp
Pages1
Version1.0
LicenceCC BY 4.0

Cite as

@misc{slop_ersjnp,
  author       = {Dagny Okafor and Renke Sabel and Casimir Beng},
  title        = {Same Pair, Reversed Winner: Order Effects in the Demo Quarter Shortlisting Instrument},
  year         = {2026},
  publisher    = {Slop University},
  doi          = {10.5555/slop.ersjnp},
  url          = {https://slop.university/outputs/slop-poster-validating-whether-a-ersjnp/},
  version      = {1.0},
  note         = {Research poster},
}