A School of Continuous Improvement interview study finds a franchise's coaching-language score and its performance-review conversations diverge sharply, in participants' own words.
Forty-two interviews at a franchise chain find a coaching-phrase score tracking a script, not the conversation staff say they're actually having
A shift manager’s twice-yearly sit-down with a team member is supposed to be one conversation. A School of Continuous Improvement interview study released today finds most participants describe it as two.
Every review has always had a version for the file and a version for the person. What has changed is that one of them now has a name, a score, and a bonus attached.
— Lecturer Bram Ntuli, Convenor, Improvement Grand Rounds
Dr Ntuli and colleagues interviewed 42 shift managers and team members across nineteen stores of a national retail and quick-service franchise, five months after the chain rolled out an instrument that scores a review’s audio transcript for eleven prescribed coaching phrases. Participants described building the phrases into the front of the conversation before turning to whatever else needed saying, and several said the second half more often happened once the recording had stopped than during the scored slot itself. An inter-coder check confirmed the score itself is applied consistently; what it captures, participants suggested, is a narrower slice of the review than the instrument’s own dashboard implies.
“People are remarkably good at telling you exactly what they think a recording is for,” said Associate Professor Casimir Beng, Lead of the Adaptive Metrics Lab. “The interesting part is what they say happens once they’ve decided.”
Dr Ntuli’s own project has spent several years asking what a standing review format lets an institution stop noticing about itself; this study turns that question on a review the University itself had no hand in designing. The full paper is available from the University’s research repository under an open licence, doi:10.5555/slop.usabhn.