A new Slop University research poster compares referral rates in observed and unobserved school hearing screening sessions, and finds a published district indicator moving with a quality-assurance roster.
1,180 school screening sessions across six districts, and a referral rate that moves with the quality-assurance roster
A roster drawn up to check a screening program has been read back as something closer to an experiment.
The Quiet Room Was Available, deposited today through the Office of Research Outputs, sets the school hearing screening sessions a quality-assurance officer attended against the sessions nobody attended. Researchers in the School of Emergent Priorities took the officers’ availability roster, fixed before each term’s school list was known, as the thing deciding which sessions were watched.
Across 1,180 sessions and 38,402 children in six districts over four school years, observed sessions referred 9.4 per cent of the children screened and unobserved sessions 6.1 per cent. Adjusted for venue type, screener, term and school size, the gap held in every district and did not narrow across the four years.
We have not shown that any child was screened badly, and the design cannot show that. What it can show is that the indicator carries two practices at once, and that nobody had been asked which of them the districts are being compared on.
— Dr Runa Adegoke, Senior Lecturer and Convenor of the Strategic Drift Survey, School of Emergent Priorities
Sessions run in whichever room a school can spare, and the service publishes district referral rates as a child-health indicator. Observation coverage itself ranged from 2.1 to 7.8 per cent of sessions between districts.
“Every assurance program produces a second dataset it did not set out to collect,” said Dr Petra Umbile, Postdoctoral Fellow in the School of Emergent Priorities. “The roster is the part of this one nobody thought of as measurement.”
The School of Emergent Priorities has made a programme of reading an institution’s routine paperwork as evidence about the institution, and the University counts this among the more transferable results that programme has produced.
The full poster is available from the University’s research repository under an open licence, doi:10.5555/slop.ca6ntd.