English

Empirical Bayes approach to Truth Discovery problems

Machine Learning 2022-06-13 v1 Artificial Intelligence

Abstract

When aggregating information from conflicting sources, one's goal is to find the truth. Most real-value \emph{truth discovery} (TD) algorithms try to achieve this goal by estimating the competence of each source and then aggregating the conflicting information by weighing each source's answer proportionally to her competence. However, each of those algorithms requires more than a single source for such estimation and usually does not consider different estimation methods other than a weighted mean. Therefore, in this work we formulate, prove, and empirically test the conditions for an Empirical Bayes Estimator (EBE) to dominate the weighted mean aggregation. Our main result demonstrates that EBE, under mild conditions, can be used as a second step of any TD algorithm in order to reduce the expected error.

Keywords

Cite

@article{arxiv.2206.04816,
  title  = {Empirical Bayes approach to Truth Discovery problems},
  author = {Tsviel Ben Shabat and Reshef Meir and David Azriel},
  journal= {arXiv preprint arXiv:2206.04816},
  year   = {2022}
}

Comments

full version of a paper accepted to UAI'22

R2 v1 2026-06-24T11:45:51.382Z