English
Related papers

Related papers: A Process Model for Crowdsourcing: Insights from t…

200 papers

Participatory budgeting is a democratic approach to deciding the funding of public projects, which has been adopted in many cities across the world. We present a survey of research on participatory budgeting emerging from the computational…

Computer Science and Game Theory · Computer Science 2020-03-03 Haris Aziz , Nisarg Shah

Common crowdsourcing systems average estimates of a latent quantity of interest provided by many crowdworkers to produce a group estimate. We develop a new approach -- predict-each-worker -- that leverages self-supervised learning and a…

Machine Learning · Computer Science 2024-02-05 Anmol Kagrecha , Henrik Marklund , Benjamin Van Roy , Hong Jun Jeon , Richard Zeckhauser

Evaluating workers is a critical aspect of any crowdsourcing system. In this paper, we devise techniques for evaluating workers by finding confidence intervals on their error rates. Unlike prior work, we focus on "conciseness"---that is,…

Databases · Computer Science 2014-11-14 Manas Joglekar , Hector Garcia-Molina , Aditya Parameswaran

Inferring the correct answers to binary tasks based on multiple noisy answers in an unsupervised manner has emerged as the canonical question for micro-task crowdsourcing or more generally aggregating opinions. In graphon estimation, one is…

Machine Learning · Statistics 2019-07-29 Devavrat Shah , Christina Lee Yu

Demonstration is an effective end-user development paradigm for teaching robots how to perform new tasks. In this paper, we posit that demonstration is useful not only as a teaching tool, but also as a way to understand and assist end-user…

Human-Computer Interaction · Computer Science 2024-03-22 David Porfirio , Allison Sauppé , Maya Cakmak , Aws Albarghouthi , Bilge Mutlu

Existing research in crowdsourcing has investigated how to recommend tasks to workers based on which task the workers have already completed, referred to as {\em implicit feedback}. We, on the other hand, investigate the task recommendation…

Artificial Intelligence · Computer Science 2016-09-08 Habibur Rahman , Lucas Joppa , Senjuti Basu Roy

In recent years, imitation learning from large-scale human demonstrations has emerged as a promising paradigm for training robot policies. However, the burden of collecting large quantities of human demonstrations is significant in terms of…

For delivering products or services to their clients, organizations execute manifold business processes. During such execution, upcoming process tasks need to be allocated to internal resources. Resource allocation is a complex…

Software Engineering · Computer Science 2024-03-29 Luise Pufahl , Sven Ihde , Fabian Stiehle , Mathias Weske , Ingo Weber

Crowdsourcing platforms enable companies to propose tasks to a large crowd of users. The workers receive a compensation for their work according to the serious of the tasks they managed to accomplish. The evaluation of the quality of…

Human-Computer Interaction · Computer Science 2019-07-25 Jean-Christophe Dubois , Laetitia Gros , Mouloud Kharoune , Yolande Le Gall , Arnaud Martin , Zoltán Miklós , Hosna Ouni

A critical issue in software development projects in IT service companies is finding the right people at the right time. By enabling assignments of tasks to people to be more fluid, the use of crowdsourcing approaches within a company…

Software Engineering · Computer Science 2020-09-14 Shinobu Saito , Yukako Iimura , Emad Aghayi , Thomas D. LaToza

Crowdsourcing provides a popular paradigm for data collection at scale. We study the problem of selecting subsets of workers from a given worker pool to maximize the accuracy under a budget constraint. One natural question is whether we…

Machine Learning · Statistics 2015-02-04 Hongwei Li , Qiang Liu

Spreading processes have been largely studied in the literature, both analytically and by means of large-scale numerical simulations. These processes mainly include the propagation of diseases, rumors and information on top of a given…

Physics and Society · Physics 2019-05-10 Guilherme Ferraz de Arruda , Francisco A. Rodrigues , Yamir Moreno

Online crowdsourcing provides a scalable and inexpensive means to collect knowledge (e.g. labels) about various types of data items (e.g. text, audio, video). However, it is also known to result in large variance in the quality of recorded…

Human-Computer Interaction · Computer Science 2018-12-10 Yuan Jin , Mark Carman , Ye Zhu , Yong Xiang

Task selection in micro-task markets can be supported by recommender systems to help individuals to find appropriate tasks. Previous work showed that for the selection process of a micro-task the semantic aspects, such as the required…

Information Retrieval · Computer Science 2017-07-21 Steffen Schnitzer , Svenja Neitzel , Christoph Rensing

Crowdsourcing has become widely used in supervised scenarios where training sets are scarce and difficult to obtain. Most crowdsourcing models in the literature assume labelers can provide answers to full questions. In classification…

Machine Learning · Computer Science 2019-08-15 Belen Saldias , Pavlos Protopapas , Karim Pichara

Workflows are prevalent in today's computing infrastructures. The workflow model support various different domains, from machine learning to finance and from astronomy to chemistry. Different Quality-of-Service (QoS) requirements and other…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-22 Laurens Versluis , Alexandru Iosup

This report presents a meta analysis of various sources from literature, research projects, and experience with the goal of collecting examples for instance-spanning constraints to be implemented through Process-Aware Information Systems.

Software Engineering · Computer Science 2016-03-07 Stefanie Rinderle-Ma , Manuel Gall , Walid Fdhila , Jürgen Mangler , Conrad Indiono

The extraction of process models from text refers to the problem of turning the information contained in an unstructured textual process descriptions into a formal representation,i.e.,a process model. Several automated approaches have been…

Artificial Intelligence · Computer Science 2023-10-26 Patrizio Bellan , Mauro Dragoni , Chiara Ghidini , Han van der Aa , Simone Paolo Ponzetto

Extracting key information from documents represents a large portion of business workloads and therefore offers a high potential for efficiency improvements and process automation. With recent advances in Deep Learning, a plethora of Deep…

Information Retrieval · Computer Science 2025-07-21 Alexander Michael Rombach , Peter Fettke

Based on the practical process of innovation and entrepreneurship education for college students in the author's university, this study analyzes and deconstructs the key concepts of AI knowledge-based crowdsourcing on the basis of…

General Economics · Economics 2022-12-13 Yufei Xie , Xiang Liu , Qizhong Yuan