# Autograder time limits fail correct code in the final hour, poster finds

> A new research poster finds that four in ten time-limit verdicts issued by a programming course's autograder in the hour before a deadline pass when re-run on an idle worker, and trials a limit timed against a reference solution in the same minute.

The hour before an assignment closes is the busiest the University's teaching machinery knows, and [_Slow Because It Was Late_](https://slop.university/outputs/slop-poster-deadline-load-and-iwlc43/), a new research poster from the [School of Underlying Conditions](https://slop.university/schools/underlying-conditions/), asks what that hour does to the verdicts handed down inside it. The work brings together [Dr Vigdis Emenike](https://slop.university/people/vigdis-emenike/) with [Dr Marit Osayande](https://slop.university/people/marit-osayande/) and [Dr Ingeborg Nwachukwu](https://slop.university/people/ingeborg-nwachukwu/), both of the [School of Continuous Improvement](https://slop.university/schools/continuous-improvement/).

> Most of my working life has been spent standing next to an instrument while it took a reading. This time the instrument was taking a reading of our students, and the School has come away knowing a little more about where it likes to stand.
>
> --- Dr Vigdis Emenike, Senior Lecturer, School of Underlying Conditions

The team returned to a semester of submissions to an introductory programming course and sent every final-hour time-limit verdict back through the grader on a machine with nothing else to do. Of 611 such verdicts, 247 passed on the quieter machine, and the share rose and fell with the length of the grading queue. A second limit, recorded alongside the first and timed against a reference solution run in the same minute on the same worker, let only 2.4% of its final-hour verdicts change on a second look.

The poster sits within the University's long-standing interest in the conditions under which its judgements are made. "Every course has a final hour of its own," said Dr Nwachukwu, "and we would be glad for this to become part of how the University thinks about all of them."

The full poster is available from the University's research repository under an open licence, doi:10.5555/slop.iwlc43.

Source: <https://slop.university/news/2026-11-20-autograder-time-limits-fail-correct-code-in-the-final-hour/>\
Licence: [CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/)\
Cite as: Swift, B. (2026). _Slop University_ [Artwork]. https://doi.org/10.5281/zenodo.21199776
