Ask About the Roundabout

Validating a Learner-Driver Logbook App's Motion-Sensor Score Against an Oral Quiz and Instructors' Independent Authenticity Judgement

A paper from the School of Continuous Improvement validates a driving-school network's Practice Hour Authenticity Index against instructors' independent authenticity judgement across 212 learners, 34 instructors, and 316 quizzed and judged drives. The motion-sensor tally alone reaches only slight agreement with instructor judgement (Cohen's kappa = 0.11); the oral quiz alone reaches moderate agreement (kappa = 0.52); the composite index, weighted 70% toward the motion-sensor component, recovers only to kappa = 0.18. An ablation stratifying by instructor years of experience leaves every estimate within a hundredth of its unadjusted value.

@misc{slop_8c99s8,
  author       = {Casimir Beng and Mirela Hanke},
  title        = {Ask About the Roundabout: Validating a Learner-Driver Logbook App's Motion-Sensor Score Against an Oral Quiz and Instructors' Independent Authenticity Judgement},
  year         = {2026},
  publisher    = {Slop University},
  doi          = {10.5555/slop.8c99s8},
  url          = {https://slop.university/outputs/slop-paper-validate-a-driving-8c99s8/},
  version      = {1.0},
  note         = {Research paper},
}