English
Related papers

Related papers: CrowdER: Crowdsourcing Entity Resolution

200 papers

Crowdsourcing is the outsourcing of tasks to a crowd of contributors on a dedicated platform. The crowd on these platforms is very diversified and includes various profiles of contributors which generates data of uneven quality. However,…

Artificial Intelligence · Computer Science 2023-03-09 Constance Thierry , Arnaud Martin , Jean-Christophe Dubois , Yolande Le Gall

Entity Resolution, also called record linkage or deduplication, refers to the process of identifying and merging duplicate versions of the same entity into a unified representation. The standard practice is to use a Rule based or Machine…

Artificial Intelligence · Computer Science 2016-09-22 Janani Balaji , Faizan Javed , Mayank Kejriwal , Chris Min , Sam Sander , Ozgur Ozturk

Crowd-sourcing is a cheap and popular means of creating training and evaluation datasets for machine learning, however it poses the problem of `truth inference', as individual workers cannot be wholly trusted to provide reliable…

Machine Learning · Computer Science 2019-02-26 Yuan Li , Benjamin I. P. Rubinstein , Trevor Cohn

Crowdsourcing provides a popular paradigm for data collection at scale. We study the problem of selecting subsets of workers from a given worker pool to maximize the accuracy under a budget constraint. One natural question is whether we…

Machine Learning · Statistics 2015-02-04 Hongwei Li , Qiang Liu

One of the most important tasks for improving data quality and the reliability of data analytics results is Entity Resolution (ER). ER aims to identify different descriptions that refer to the same real-world entity, and remains a…

Entity resolution (ER) is the task of identifying records belonging to the same entity (e.g. individual, group) across one or multiple databases. Ironically, it has multiple names: deduplication and record linkage, among others. In this…

Databases · Computer Science 2015-09-15 Matt Barnes

Entity Resolution (ER) is a critical data cleaning task for identifying records that refer to the same real-world entity. In the era of Big Data, traditional batch ER is often infeasible due to volume and velocity constraints, necessitating…

Databases · Computer Science 2026-01-05 Dimitrios Karapiperis , George Papadakis , Vassilios Verykios

As the use of crowdsourcing increases, it is important to think about performance optimization. For this purpose, it is possible to think about each worker as a HPU(Human Processing Unit), and to draw inspiration from performance…

Human-Computer Interaction · Computer Science 2016-10-17 Chen Cao , Zheng Liu , Lei Chen , H. V. Jagadish

Entity resolution (ER) refers to the problem of matching records in one or more relations that refer to the same real-world entity. While supervised machine learning (ML) approaches achieve the state-of-the-art results, they require a large…

Databases · Computer Science 2020-04-07 Renzhi Wu , Sanya Chaba , Saurabh Sawlani , Xu Chu , Saravanan Thirumuruganathan

Pure machine-based solutions usually struggle in the challenging classification tasks such as entity resolution (ER). To alleviate this problem, a recent trend is to involve the human in the resolution process, most notably the…

Databases · Computer Science 2018-08-15 Zhaoqiang Chen , Qun Chen , Boyi Hou , Murtadha Ahmed , Zhanhuai Li

Crowdsourcing is a process of accumulating the ideas, thoughts or information from many independent participants, with aim to find the best solution for a given challenge. Modern information technologies allow for massive number of subjects…

Physics and Society · Physics 2016-04-04 Andrea Guazzini , Daniele Vilone , Camillo Donati , Annalisa Nardi , Zoran Levnajic

Ranking a set of samples based on subjectivity, such as the experience quality of streaming video or the happiness of images, has been a typical crowdsourcing task. Numerous studies have employed paired comparison analysis to solve…

Human-Computer Interaction · Computer Science 2023-02-24 Ming-Hung Wang , Chia-Yuan Zhang , Jia-Ru Song

We study the problem of organizing a collection of objects - images, videos - into clusters, using crowdsourcing. This problem is notoriously hard for computers to do automatically, and even with crowd workers, is challenging to…

Databases · Computer Science 2016-01-12 Ayush Jain , Joon Young Seo , Karan Goel , Andrew Kuznetsov , Aditya Parameswaran , Hari Sundaram

Crowdsourcing offers a practical method for ranking and scoring large amounts of items. To investigate the algorithms and incentives that can be used in crowdsourcing quality evaluations, we built CrowdGrader, a tool that lets students…

Social and Information Networks · Computer Science 2013-08-27 Luca de Alfaro , Michael Shavlovsky

In this work, we initiate the investigation of optimization opportunities in collaborative crowdsourcing. Many popular applications, such as collaborative document editing, sentence translation, or citizen science resort to this special…

Hybrid crowd-machine classifiers can achieve superior performance by combining the cost-effectiveness of automatic classification with the accuracy of human judgment. This paper shows how crowd and machines can support each other in…

Machine Learning · Computer Science 2021-01-25 Evgeny Krivosheev , Fabio Casati , Alessandro Bozzon

Crowdsourcing has emerged as an effective platform for labeling large amounts of data in a cost- and time-efficient manner. Most previous work has focused on designing an efficient algorithm to recover only the ground-truth labels of the…

Human-Computer Interaction · Computer Science 2023-06-01 Hyeonsu Jeong , Hye Won Chung

Many data mining tasks cannot be completely addressed by auto- mated processes, such as sentiment analysis and image classification. Crowdsourcing is an effective way to harness the human cognitive ability to process these machine-hard…

Databases · Computer Science 2018-10-22 Chengliang Chai , Ju Fan , Guoliang Li , Jiannan Wang , Yudian Zheng

Crowdsourcing allows running simple human intelligence tasks on a large crowd of workers, enabling solving problems for which it is difficult to formulate an algorithm or train a machine learning model in reasonable time. One of such…

Human-Computer Interaction · Computer Science 2023-06-05 Daniil Likhobaba , Daniil Fedulov , Dmitry Ustalov

We present SmartCrowd, a framework for optimizing collaborative knowledge-intensive crowdsourcing. SmartCrowd distinguishes itself by accounting for human factors in the process of assigning tasks to workers. Human factors designate…