Dr Dagny Okafor, Associate Professor Casimir Beng and Dr Bram Ntuli take the Calibration Maturity Index from its five levels to a partner firm's bonus pools in a short film from the School of Continuous Improvement.
Dagny Okafor, Casimir Beng and Bram Ntuli talk through five levels of calibration practice, 156 review sessions and the bonus-pool schedule a partner firm set by the level alone
At the top of the School of Continuous Improvement’s Calibration Maturity Index, the median performance-review calibration session ran to nearly two hours, with sixteen pages of evidence for every nominee, and its ratings agreed with an independent panel’s about as well as those of a session run on anecdote. CMI, Explained, a new research explainer from the School, walks through the paper behind that result, CMI, with its three authors, Dr Dagny Okafor, Associate Professor Casimir Beng and Dr Bram Ntuli.
Most instruments live quietly in a spreadsheet. It has been a real pleasure to watch this one make its way out into the world, and now onto the screen.
— Dr Bram Ntuli, Lecturer and Convenor, Improvement Grand Rounds
Behind the film sits a design built for confidence: two trained coders scored 156 sessions across 52 business units of a professional-services firm against the index’s five named practices, from anecdote to blind recalibration, and an outside panel re-scored the employees behind them without seeing either the original ratings or the levels. Attained level and rating accuracy kept a respectful distance throughout, and the explainer closes on the schedule of bonus-pool multipliers the firm’s remuneration committee adopted partway through the study, keyed to the level alone.
An instrument that its partner organisation found ready for use before the study describing it had concluded is, the School notes, a rare compliment to its design.
The full explainer is available from the University’s research repository under an open licence, doi:10.5555/slop.1u6zxa.