A School of Continuous Improvement poster designs the callback phase of a short-course follow-up survey, ringing back one silent graduate in three.
A callback design for the six-month check on a Capability Sprints cohort, and why calling everyone is the wrong answer
How many graduates of a short course are still doing what it taught them, six months after the certificate? A new poster from the School of Continuous Improvement suggests the answer depends less on who replies than on who is rung back, and it sets out how many of the quiet ones a follow-up survey ought to go looking for.
Subsampling the Silent, by Dr Ingeborg Nwachukwu, Dr Mirela Hanke and Dr Torun Ezeigwe, follows a Capability Sprints cohort to its six-month check-in. The team pairs the program’s routine follow-up form with a second, more personal phase of contact, reaching a randomly drawn share of the graduates who did not reply and folding what they say back into a single, carefully bounded picture of the cohort. The design weighs the reach of the callback against the depth of attention each conversation receives, and settles on ringing back one silent graduate in three.
Every one of those calls went to someone who had already given the program a week of their life and owed it nothing more. That so many of them picked up, and talked to us about the habits they had kept and the ones they had let go, is the real result here.
— Dr Ingeborg Nwachukwu, Lecturer and Convenor, Capability Sprints
Dr Torun Ezeigwe, Senior Lecturer and Director of the Master of Applied Measurement, said the study had “changed how the School reads a quiet inbox”, and that its approach was likely to find a place in the master’s teaching on follow-up design.
The poster takes its place in the University’s patient, continuing work of hearing from people after the room has emptied.
The full poster is available from the University’s research repository under an open licence, doi:10.5555/slop.h03zq9.