English
Related papers

Related papers: Optimal Inference in Crowdsourced Classification v…

200 papers

Belief propagation is a fundamental message-passing algorithm for probabilistic reasoning and inference in graphical models. While it is known to be exact on trees, in most applications belief propagation is run on graphs with cycles.…

Machine Learning · Computer Science 2019-05-27 Frederic Koehler

We study crowdsourced PAC learning of threshold functions, where the labels are gathered from a pool of annotators some of whom may behave adversarially. This is yet a challenging problem and until recently has computationally and query…

Machine Learning · Computer Science 2022-12-07 Shiwei Zeng , Jie Shen

We study the behavior of the belief-propagation (BP) algorithm affected by erroneous data exchange in a wireless sensor network (WSN). The WSN conducts a distributed binary hypothesis test where the joint statistical behavior of the sensor…

Information Theory · Computer Science 2020-04-14 Younes Abdi , Tapani Ristaniemi

Max-product Belief Propagation (BP) is a popular message-passing algorithm for computing a Maximum-A-Posteriori (MAP) assignment over a distribution represented by a Graphical Model (GM). It has been shown that BP can solve a number of…

Data Structures and Algorithms · Computer Science 2015-09-24 Sungsoo Ahn , Sejun Park , Michael Chertkov , Jinwoo Shin

Crowdsourcing has become an efficient paradigm for performing large scale tasks. Truth discovery and incentive mechanism are fundamentally important for the crowdsourcing system. Many truth discovery methods and incentive mechanisms for…

Computer Science and Game Theory · Computer Science 2019-02-12 Lingyun Jiang , Xiaofu Niu , Jia Xu , Dejun Yang , Lijie Xu

Due to the noises in crowdsourced labels, label aggregation (LA) has emerged as a standard procedure to post-process crowdsourced labels. LA methods estimate true labels from crowdsourced labels by modeling worker qualities. Most existing…

Human-Computer Interaction · Computer Science 2022-12-02 Yi Yang , Zhong-Qiu Zhao , Quan Bai , Qing Liu , Weihua Li

Crowdsourcing platforms offer a way to label data by aggregating answers of multiple unqualified workers. We introduce a \textit{simple} and \textit{budget efficient} crowdsourcing method named Proxy Crowdsourcing (PCS). PCS collects…

Computer Science and Game Theory · Computer Science 2018-06-19 Gal Cohensius , Omer Ben Porat , Reshef Meir , Ofra Amir

Crowdsourcing has become very popular among the machine learning community as a way to obtain labels that allow a ground truth to be estimated for a given dataset. In most of the approaches that use crowdsourced labels, annotators are asked…

Machine Learning · Statistics 2018-08-09 Iker Beñaran-Muñoz , Jerónimo Hernández-González , Aritz Pérez

Existing machine learning models have proven to fail when it comes to their performance for minority groups, mainly due to biases in data. In particular, datasets, especially social data, are often not representative of minorities. In this…

Databases · Computer Science 2023-06-27 Melika Mousavi , Nima Shahbazi , Abolfazl Asudeh

We investigate the unsupervised node classification problem on random hypergraphs under the non-uniform Hypergraph Stochastic Block Model (HSBM) with two equal-sized communities. In this model, edges appear independently with probabilities…

Statistics Theory · Mathematics 2025-12-01 Hai-Xiao Wang

Modern machine learning algorithms need large datasets to be trained. Crowdsourcing has become a popular approach to label large datasets in a shorter time as well as at a lower cost comparing to that needed for a limited number of experts.…

Human-Computer Interaction · Computer Science 2019-12-11 Alexey Drutsa , Viktoriya Farafonova , Valentina Fedorova , Olga Megorskaya , Evfrosiniya Zerminova , Olga Zhilinskaya

We describe a novel approach to statistical learning from particles tracked while moving in a random environment. The problem consists in inferring properties of the environment from recorded snapshots. We consider here the case of a fluid…

Information Theory · Computer Science 2008-06-09 Michael Chertkov , Lukas Kroc , Massimo Vergassola

Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partition functions, arise…

Machine Learning · Computer Science 2017-08-09 Damian Straszak , Nisheeth K. Vishnoi

The framework of statistical inference has been successfully used to detect the meso-scale structures in complex networks, such as community structure, core-periphery (CP) structure. The main principle is that the stochastic block model…

Physics and Society · Physics 2018-08-29 Chuang Ma , Bing-Bing Xiang , Han-Shuang Chen , Hai-Feng Zhang

Concept Bottleneck Models (CBMs) propose to enhance the trustworthiness of AI systems by constraining their decisions on a set of human-understandable concepts. However, CBMs typically assume that datasets contain accurate concept labels-an…

Machine Learning · Computer Science 2025-09-09 Emiliano Penaloza , Tianyue H. Zhang , Laurent Charlin , Mateo Espinosa Zarlenga

This paper presents the first systematic investigation of the potential performance gains for crowdsourcing systems, deriving from available information at the requester about individual worker earnestness (reputation). In particular, we…

Human-Computer Interaction · Computer Science 2014-12-01 Alberto Tarable , Alessandro Nordio , Emilio Leonardi , Marco Ajmone Marsan

The paper investigates parameterized approximate message-passing schemes that are based on bounded inference and are inspired by Pearl's belief propagation algorithm (BP). We start with the bounded inference mini-clustering algorithm and…

Artificial Intelligence · Computer Science 2014-01-16 Robert Mateescu , Kalev Kask , Vibhav Gogate , Rina Dechter

We consider the problem of maximum likelihood estimation in linear models represented by factor graphs and solved via the Gaussian belief propagation algorithm. Motivated by massive internet of things (IoT) networks and edge computing, we…

Information Theory · Computer Science 2023-05-31 Mirsad Cosovic , Dragisa Miskovic , Muhamed Delalic , Darijo Raca , Dejan Vukobratovic

Deep neural networks are known to be overconfident when applied to out-of-distribution (OOD) inputs which clearly do not belong to any class. This is a problem in safety-critical applications since a reliable assessment of the uncertainty…

Machine Learning · Computer Science 2021-03-11 Julian Bitterwolf , Alexander Meinke , Matthias Hein

Probabilistic inference problems arise naturally in distributed systems such as sensor networks and teams of mobile robots. Inference algorithms that use message passing are a natural fit for distributed systems, but they must be robust to…

Artificial Intelligence · Computer Science 2012-07-19 Mark Paskin , Carlos E. Guestrin