A new Slop University research poster audits a hardware chain's photo-based gas-bottle condition-check app against staff visual checks and an independent inspector's blind reassessment, and finds the app adds handling time but no extra safety signal.
A season-long swap-cage audit finds a hardware chain's photo-check app adds counter time without catching anything the staff glance didn't already catch
At gas-bottle swap cages run by a hardware chain, a photo-based condition-check app now looks at every returned cylinder before a staff member does. A new Slop University research poster from the School of Emergent Priorities and the School of Continuous Improvement asks what the second look catches that the first one didn’t, tracking both gradings against an independent inspector’s blind reassessment across a full season.
Senior Lecturer Ronja Oyelaran and Lecturer Marit Osayande followed 214 cylinders through six swap cages over fourteen weeks, having each one scored three separate times, by counter staff, by the app, and by an inspector working blind to both, with the scoring order rotated week to week so neither check could learn the other’s habits.
A second check only earns its keep if it catches something the first one missed; ours mostly just confirmed it.
— Senior Lecturer Ronja Oyelaran, School of Emergent Priorities
App-graded and staff-graded calls agreed with each other on 96% of cylinders, and matched the inspector’s independent read at closely comparable rates across the season. “The app didn’t need to be wrong to be expensive,” said Lecturer Marit Osayande, Convenor of the Living Dashboard. “A season of added counter time is the kind of cost that rarely shows up on the same ledger as the safety case that justified it.”
For the School of Emergent Priorities, a second check that mostly agrees with the first is its own kind of finding, and the swap cages gave the School an unusually clean one to sit with this season.
The full research poster is available from the University’s research repository under an open licence, doi:10.5555/slop.b7j0ib.