Human Responses to Algorithmic Correction: Evidence from Centre Court

arXiv:2401.16754 · cs.LG, cs.CY, econ.GN, q-fin.EC · Submitted 2024-01-30 · Read on arXiv

cs.LG, cs.CY, econ.GN, q-fin.EC

Submitted: 2024-01-30

Updated: 2026-10-18

License: http://creativecommons.org/licenses/by/4.0/

The gist: We study how algorithmic review changes the initial decisions that a system is designed to correct.

Terminology

Abstract

We study how algorithmic review changes the initial decisions that a system is designed to correct. Using Hawk-Eye data from professional tennis, we compare umpire decisions with and without review against a common accuracy benchmark. Under review, initial errors were 8.6 percentage points higher just outside the line and lower for comparably close balls inside. We find no evidence that average initial accuracy deteriorated. Within matches, reversals were followed by larger adjustments than upheld calls, consistent with adaptation to correction. Overall, correction offsets worse initial decisions for incorrect in calls and reinforces better initial decisions for incorrect out calls. Whether review lowers organizational costs depends jointly on these changes and the costs of remedying corrected errors. A conditional illustration shows how utilization spreads fixed review costs across calls.

Related papers