AuDQ: Auditable Data Quality through Agentic Rule Discovery

arXiv:2610.26031 · cs.AI, q-fin.CP · Submitted 2026-10-19 · Read on arXiv

cs.AI, q-fin.CP

Submitted: 2026-10-19

Updated: 2026-10-19

License: http://creativecommons.org/licenses/by-nc-nd/4.0/

The gist: High-stakes tabular pipelines rely on scattered, static quality checks that are hard to evolve and audit against policy intent.

Abstract

High-stakes tabular pipelines rely on scattered, static quality checks that are hard to evolve and audit against policy intent. Regulated domains particularly suffer as the LLM-era automation raises expectations for traceability and accountability. We propose a vision for an ontology-grounded, repository-native data quality layer in which rules are first-class artifacts: versioned, provenance-linked to governance texts, and re-playable through immutable execution traces. As a first step toward validating this vision, we present a concrete implementation of its agentic rule-discovery core with two rule acquisition modes (Full-Agentic and Guided) and a human-in-the-loop (HITL) review interface. We define an evaluation framework and run experiments addressing whether our fully autonomous, divide-and-conquer agentic rule discovery produces rules of the same quality and diversity as those specified by a human expert, reporting preliminary results on two real world industry datasets in the finance and retail domains.

Related papers