English
Related papers

Related papers: Building Robust Crowdsourcing Systems with Reputat…

200 papers

Mobile sensing has become a promising paradigm for mobile users to obtain information by task crowdsourcing. However, due to the social preferences of mobile users, the quality of sensing reports may be impacted by the underlying social…

Networking and Internet Architecture · Computer Science 2015-07-23 Ju Ren , Yaoxue Zhang , Kuan Zhang , Xuemin , Shen

A central question of crowd-sourcing is how to elicit expertise from agents. This is even more difficult when answers cannot be directly verified. A key challenge is that sophisticated agents may strategically withhold effort or information…

Computer Science and Game Theory · Computer Science 2018-05-24 Yuqing Kong , Grant Schoenebeck

Crowdsourcing system has emerged as an effective platform for labeling data with relatively low cost by using non-expert workers. Inferring correct labels from multiple noisy answers on data, however, has been a challenging problem, since…

Human-Computer Interaction · Computer Science 2023-09-14 Doyeon Kim , Jeonghwan Lee , Hye Won Chung

In recent years, imitation learning from large-scale human demonstrations has emerged as a promising paradigm for training robot policies. However, the burden of collecting large quantities of human demonstrations is significant in terms of…

Reputation-based cooperation on social networks offers a causal mechanism between graph properties and social trust. Recent papers on the `structural microfoundations` of the society used this insight to show how demographic processes, such…

Social and Information Networks · Computer Science 2022-03-02 Tamas David-Barrett

A human-swarm cooperative system, which mixes multiple robots and a human supervisor to form a heterogeneous team, is widely used for emergent scenarios such as criminal tracking in social security and victim assistance in a natural…

Robotics · Computer Science 2021-03-09 Yijiang Pang , Rui Liu

The spread of online reviews, ratings and opinions and its growing influence on people's behavior and decisions boosted the interest to extract meaningful information from this data deluge. Hence, crowdsourced ratings of products and…

Information Retrieval · Computer Science 2017-05-03 João Saúde , Guilherme Ramos , Carlos Caleiro , Soummya Kar

This paper presents the first systematic investigation of the potential performance gains for crowd work systems, deriving from available information at the requester about individual worker reputation. In particular, we first formalize the…

Human-Computer Interaction · Computer Science 2016-05-27 A. Tarable , A. Nordio , E. Leonardi , M. Ajmone Marsan

Mobile sensing is an emerging technology that utilizes agent-participatory data for decision making or state estimation, including multimedia applications. This article investigates the structure of mobile sensing schemes and introduces…

Social and Information Networks · Computer Science 2016-11-15 Pin-Yu Chen , Shin-Ming Cheng , Pai-Shun Ting , Chia-Wei Lien , Fu-Jen Chu

Spatial crowdsourcing (SC) enables the assignment of location-based tasks to mobile users who must travel to specific locations to perform sensing or service activities. However, SC systems often operate in strategic environments where both…

Computer Science and Game Theory · Computer Science 2026-04-27 Chattu Bhargavi , Vikash Kumar Singh , Alok Kumar Shukla

Crowdsourcing offers an affordable and scalable means to collect relevance judgments for IR test collections. However, crowd assessors may show higher variance in judgment quality than trusted assessors. In this paper, we investigate how to…

Information Retrieval · Computer Science 2018-06-12 Mucahid Kutlu , Tyler McDonnell , Aashish Sheshadri , Tamer Elsayed , Matthew Lease

Mobility in an effective and socially-compliant manner is an essential yet challenging task for robots operating in crowded spaces. Recent works have shown the power of deep reinforcement learning techniques to learn socially cooperative…

Robotics · Computer Science 2024-10-30 Changan Chen , Yuejiang Liu , Sven Kreiss , Alexandre Alahi

We investigate crowdsourcing algorithms for finding the top-quality item within a large collection of objects with unknown intrinsic quality values. This is an important problem with many relevant applications, for example in networked…

Human-Computer Interaction · Computer Science 2017-10-03 Alessandro Nordio , Alberto Tarable , Emilio Leonardi , Marco Ajmone Marsan

Several works related to spatial crowdsourcing have been proposed in the direction where the task executers are to perform the tasks within the stipulated deadlines. Though the deadlines are set, it may be a practical scenario that majority…

Computational Engineering, Finance, and Science · Computer Science 2024-02-08 Naren Debnath , Sajal Mukhopadhyay , Fatos Xhafa

Crowdsourcing platforms enable companies to propose tasks to a large crowd of users. The workers receive a compensation for their work according to the serious of the tasks they managed to accomplish. The evaluation of the quality of…

Human-Computer Interaction · Computer Science 2019-07-25 Jean-Christophe Dubois , Laetitia Gros , Mouloud Kharoune , Yolande Le Gall , Arnaud Martin , Zoltán Miklós , Hosna Ouni

Human-robot teams have the ability to perform better across various tasks than human-only and robot-only teams. However, such improvements cannot be realized without proper task allocation. Trust is an important factor in teaming…

Robotics · Computer Science 2021-10-12 Arsha Ali , Hebert Azevedo-Sa , Dawn M. Tilbury , Lionel P. Robert

The present research examines two problems inherent to the creation of crowdsourcing games: how to give feedback when the right answer is not always known by the game and how much time to give players without sacrificing data quality. Taken…

Human-Computer Interaction · Computer Science 2016-09-09 Gili Freedman , Sukdith Punjasthitkul , Max Seidman , Mary Flanagan

This paper is concerned with the problem of designing, from data, agents that are able to craft their behavior from a number of contributors in order to fulfill some agent-specific task. This is not necessarily known to the contributors.…

Optimization and Control · Mathematics 2020-11-04 Giovanni Russo

Linguistically diverse datasets are critical for training and evaluating robust machine learning systems, but data collection is a costly process that often requires experts. Crowdsourcing the process of paraphrase generation is an…

Computation and Language · Computer Science 2020-06-05 Youxuan Jiang , Jonathan K. Kummerfeld , Walter S. Lasecki

Collaborative Mobile Crowdsourcing (CMCS) allows platforms to recruit worker teams to collaboratively execute complex sensing tasks. The efficiency of such collaborations could be influenced by trust relationships among workers. To obtain…

Social and Information Networks · Computer Science 2024-03-25 Zhongwei Zhan , Yingjie Wang , Peiyong Duan , Akshita Maradapu Vera Venkata Sai , Zhaowei Liu , Chaocan Xiang , Xiangrong Tong , Weilong Wang , Zhipeng Cai