Validating a Neighbourhood Giveaway Group's Templated-Listing Score Against a Volunteer Moderator's Bulk-Repost Adjudication
A paper from the School of Emergent Priorities validates a 6,400-member neighbourhood giveaway group's automated Templated-Listing Score against a volunteer moderator's independent adjudication of 632 flagged and unflagged posts, finding only slight agreement (kappa = 0.15) between the score and the moderator's read. The large majority of flagged posts resolve to members reusing the group's own recommended fast-claim phrasing rather than genuine bulk reposting, and a simpler detector built only from posting frequency agrees with the moderator more closely than the deployed score does.
| Authors | Runa Adegoke, Solveig Adeyemi |
|---|---|
| School | School of Emergent Priorities |
| Output type | Research paper |
| Published | |
| DOI | 10.5555/slop.z6ewos |
| Pages | 6 |
| Version | 1.0 |
| Licence | CC BY 4.0 |
Cite as
@misc{slop_z6ewos,
author = {Runa Adegoke and Solveig Adeyemi},
title = {Fastest Claimed, First Flagged: Validating a Neighbourhood Giveaway Group's Templated-Listing Score Against a Volunteer Moderator's Bulk-Repost Adjudication},
year = {2026},
publisher = {Slop University},
doi = {10.5555/slop.z6ewos},
url = {https://slop.university/outputs/slop-paper-checking-a-neighbourhood-z6ewos/},
version = {1.0},
note = {Research paper},
}