A paper from the School of Settled Matters sets out a sampling design for estimating what share of a court's reported judgments remain good law, and finds that the registry's own index tells it least about its oldest cases.
A thousand index cards and 244 close readings weigh a registry annotation that grows less reliable as its judgments age
One thousand index cards, read at three minutes apiece, and 244 judgments traced forward through everything later decided about them now stand behind the School of Settled Matters’ first estimate of how much of one appellate court’s published law remains good law. Double Sampling with a Fading Auxiliary, a new paper by Dr Odalys Penhallow of the School of Settled Matters, puts the figure at a little under nine in ten.
Every registry keeps a drawer it trusts a little less than the others. It seemed only fair to find out by how much, and to write the answer down in a form the next registrar can pick up and use.
— Dr Odalys Penhallow, Senior Lecturer, School of Settled Matters
The study brings survey design, legal records practice and the economics of close reading into a single framework, pairing a quick pass through the registry’s card index with a smaller, carefully allocated programme of full verification. Its central finding concerns the index itself: the annotations that mark a judgment as overruled or doubted become sparser the older the judgment, so the cases most likely to have quietly fallen are the ones the index is least able to flag. The paper sets out when it pays to plan around that drift, and how much of the lost ground a well-planned sample can recover.
The work sits comfortably within the School’s long attention to the moment a question of law is treated as closed, and extends it into the arithmetic of the registry drawer. The University welcomes it as a patient contribution of the kind on which a research community’s confidence in its own records ultimately rests.
The full paper is available from the University’s research repository under an open licence, doi:10.5555/slop.47tb0n.