中文

Top-k Approximate Functional Dependency Discovery

数据库 2026-05-26 v1

摘要

Approximate functional dependencies (AFDs) relax exact functional dependencies by tolerating a bounded degree of violation, making them suited for data quality auditing. Threshold-based discovery returns all dependencies above a user-specified cutoff, but output size is uncontrollable, the right threshold varies across datasets, and widely used measures are sensitive to LHS dimensionality. We study global top-kk AFD discovery, where neither the LHS nor the RHS is fixed and the kk strongest dependencies under μ+\mu^+ are returned directly. The cross-attribute comparability of μ+\mu^+ makes such a global ranking well-defined. We prove a Triangle Incompatibility Theorem showing that minimality, global top-kk ranking, and exact-kk output cannot simultaneously hold under any non-monotonic scoring function, justifying the removal of the minimality requirement. We present two algorithms: TALE-Base, which returns the exact global top-kk result by exhaustive level-wise evaluation, and TALE-Opt, which reduces computation through Apriori-style candidate generation, LHS computation reuse, and two complementary pruning rules exploiting exact FD monotonicity and an optimistic upper bound on μ+\mu^+. Experiments on 41 real-world datasets show that TALE-Opt achieves pruning ratios up to 99.81\% and speedups over TALE-Base up to 78.81×\times.

关键词

引用

@article{arxiv.2605.24925,
  title  = {Top-k Approximate Functional Dependency Discovery},
  author = {Xiaolong Wan and Xixian Han},
  journal= {arXiv preprint arXiv:2605.24925},
  year   = {2026}
}