English
Related papers

Related papers: A Streaming Algorithm for Crowdsourced Data Classi…

200 papers

Inferring the correct answers to binary tasks based on multiple noisy answers in an unsupervised manner has emerged as the canonical question for micro-task crowdsourcing or more generally aggregating opinions. In graphon estimation, one is…

Machine Learning · Statistics 2019-07-29 Devavrat Shah , Christina Lee Yu

This paper models the crowdsourced labeling/classification problem as a sparsely encoded source coding problem, where each query answer, regarded as a code bit, is the XOR of a small number of labels, as source information bits. In this…

Machine Learning · Statistics 2020-02-03 James Chin-Jen Pang , Hessam Mahdavifar , S. Sandeep Pradhan

Gathering training data is a key step of any supervised learning task, and it is both critical and expensive. Critical, because the quantity and quality of the training data has a high impact on the performance of the learned function.…

Data Structures and Algorithms · Computer Science 2021-10-28 Quentin Lutz , Élie de Panafieu , Alex Scott , Maya Stein

In this paper, we design the first streaming algorithms for the problem of multitasking scheduling on parallel machines with shared processing. In one pass, our streaming approximation schemes can provide an approximate value of the optimal…

Data Structures and Algorithms · Computer Science 2022-04-06 Bin Fu , Yumei Huo , Hairong Zhao

With the rapidly increasing interest in machine learning based solutions for automatic image annotation, the availability of reference annotations for algorithm training is one of the major bottlenecks in the field. Crowdsourcing has…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Eric Heim , Alexander Seitel , Jonas Andrulis , Fabian Isensee , Christian Stock , Tobias Ross , Lena Maier-Hein

We consider the $M$-ary classification problem via crowdsourcing, where crowd workers respond to simple binary questions and the answers are aggregated via decision fusion. The workers have a reject option to skip answering a question when…

Human-Computer Interaction · Computer Science 2020-08-26 Baocheng Geng , Qunwei Li , Pramod K. Varshney

The non-stationary nature of data streams strongly challenges traditional machine learning techniques. Although some solutions have been proposed to extend traditional machine learning techniques for handling data streams, these approaches…

Machine Learning · Computer Science 2021-06-23 Xuyang Yan , Abdollah Homaifar , Mrinmoy Sarkar , Abenezer Girma , Edward Tunstel

In this paper, we explore how to efficiently combine crowdsourcing and machine intelligence for the problem of document screening, where we need to screen documents with a set of machine-learning filters. Specifically, we focus on building…

Information Retrieval · Computer Science 2020-12-07 Evgeny Krivosheev , Burcu Sayin , Alessandro Bozzon , Zoltán Szlávik

Crowdsourcing has been successfully employed in the past as an effective and cheap way to execute classification tasks and has therefore attracted the attention of the research community. However, we still lack a theoretical understanding…

Human-Computer Interaction · Computer Science 2016-10-20 Edoardo Manino , Long Tran-Thanh , Nicholas R. Jennings

The efficiency of top-K item recommendation based on implicit feedback are vital to recommender systems in real world, but it is very challenging due to the lack of negative samples and the large number of candidate items. To address the…

Information Retrieval · Computer Science 2019-06-06 Haoyu Wang , Defu Lian , Yong Ge

With the popularity of massive open online courses, grading through crowdsourcing has become a prevalent approach towards large scale classes. However, for getting grades for complex tasks, which require specific skills and efforts for…

Artificial Intelligence · Computer Science 2017-03-31 Lingyu Lyu , Mehmed Kantardzic

Large-scale labeled dataset is the indispensable fuel that ignites the AI revolution as we see today. Most such datasets are constructed using crowdsourcing services such as Amazon Mechanical Turk which provides noisy labels from…

Human-Computer Interaction · Computer Science 2022-03-15 Chong Liu , Yu-Xiang Wang

In many machine learning applications, it is important to explain the predictions of a black-box classifier. For example, why does a deep neural network assign an image to a particular class? We cast interpretability of black-box…

Machine Learning · Statistics 2017-11-27 Ethan R. Elenberg , Alexandros G. Dimakis , Moran Feldman , Amin Karbasi

Machine learning systems are increasingly deployed in high-stakes domains, yet they remain vulnerable to bias systematic disparities that disproportionately impact specific demographic groups. Traditional bias detection methods often depend…

Machine Learning · Computer Science 2025-06-16 Chirudeep Tupakula , Rittika Shamsuddin

We present and empirically evaluate an efficient algorithm that learns to aggregate the predictions of an ensemble of binary classifiers. The algorithm uses the structure of the ensemble predictions on unlabeled data to yield significant…

Machine Learning · Computer Science 2015-11-12 Akshay Balsubramani , Yoav Freund

Consider designing an effective crowdsourcing system for an $M$-ary classification task. Crowd workers complete simple binary microtasks whose results are aggregated to give the final result. We consider the novel scenario where workers…

Machine Learning · Computer Science 2016-12-14 Qunwei Li , Aditya Vempaty , Lav R. Varshney , Pramod K. Varshney

In this paper, we analyze PAC learnability from labels produced by crowdsourcing. In our setting, unlabeled examples are drawn from a distribution and labels are crowdsourced from workers who operate under classification noise, each with…

Machine Learning · Computer Science 2019-02-14 Shelby Heinecke , Lev Reyzin

In this paper, we propose a general and novel formulation of ranking and selection with the existence of streaming input data. The collection of multiple streams of such data may consume different types of resources, and hence can be…

Machine Learning · Statistics 2025-03-18 Yuhao Wang , Enlu Zhou

The data deluge comes with high demands for data labeling. Crowdsourcing (or, more generally, ensemble learning) techniques aim to produce accurate labels via integrating noisy, non-expert labeling from annotators. The classic Dawid-Skene…

Machine Learning · Computer Science 2019-09-30 Shahana Ibrahim , Xiao Fu , Nikos Kargas , Kejun Huang

Crowdsourcing systems commonly face the problem of aggregating multiple judgments provided by potentially unreliable workers. In addition, several aspects of the design of efficient crowdsourcing processes, such as defining worker's…

Artificial Intelligence · Computer Science 2016-04-20 Matteo Venanzi , John Guiver , Pushmeet Kohli , Nick Jennings