English
Related papers

Related papers: Scalable Entity Resolution Using Probabilistic Sig…

200 papers

Graph clustering and community detection are central problems in modern data mining. The increasing need for analyzing billion-scale data calls for faster and more scalable algorithms for these problems. There are certain trade-offs between…

Social and Information Networks · Computer Science 2021-08-05 Jessica Shi , Laxman Dhulipala , David Eisenstat , Jakub Łącki , Vahab Mirrokni

Entity resolution (ER), comprising record linkage and de-duplication, is the process of merging noisy databases in the absence of unique identifiers to remove duplicate entities. One major challenge of analysis with linked data is…

Methodology · Statistics 2022-02-10 Andee Kaplan , Brenda Betancourt , Rebecca C. Steorts

Entity extraction is fundamental to many text mining tasks such as organisation name recognition. A popular approach to entity extraction is based on matching sub-string candidates in a document against a dictionary of entities. To handle…

Databases · Computer Science 2017-02-14 Zeyi Wen , Dong Deng , Rui Zhang , Kotagiri Ramamohanarao

Accurately identifying different representations of the same real-world entity is an integral part of data cleaning and many methods have been proposed to accomplish it. The challenges of this entity resolution task that demand so much…

Machine Learning · Computer Science 2021-06-02 Alex Bogatu , Norman W. Paton , Mark Douthwaite , Stuart Davie , Andre Freitas

Entity resolution is a widely studied problem with several proposals to match records across relations. Matching textual content is a widespread task in many applications, such as question answering and search. While recent methods achieve…

Databases · Computer Science 2021-12-17 Naser Ahmadi , Hansjorg Sand , Paolo Papotti

Accurate and efficient entity resolution (ER) is a significant challenge in many data mining and analysis projects requiring integrating and processing massive data collections. It is becoming increasingly important in real-world…

Databases · Computer Science 2021-11-09 Samudra Herath , Matthew Roughan , Gary Glonek

Blocking is a mechanism to improve the efficiency of Entity Resolution (ER) which aims to quickly prune out all non-matching record pairs. However, depending on the distributions of entity cluster sizes, existing techniques can be either…

Databases · Computer Science 2021-03-17 Sainyam Galhotra , Donatella Firmani , Barna Saha , Divesh Srivastava

Real-world data contains various kinds of errors. Before analyzing data, one usually needs to process the raw data. However, traditional data processing based on exactly match often misses lots of valid information. To get high-quality…

Databases · Computer Science 2017-12-19 Dong Deng

This paper studies rule-based blocking in Entity Resolution (ER). We propose HyperBlocker, a GPU-accelerated system for blocking in ER. As opposed to previous blocking algorithms and parallel blocking solvers, HyperBlocker employs a…

Databases · Computer Science 2024-12-16 Xiaoke Zhu , Min Xie , Ting Deng , Qi Zhang

Entity Resolution (ER) is the problem of determining when two entities refer to the same underlying entity. The problem has been studied for over 50 years, and most recently, has taken on new importance in an era of large, heterogeneous…

Artificial Intelligence · Computer Science 2023-07-25 Mayank Kejriwal

We consider the problem of selecting the best variable-value strategy for solving a given problem in constraint programming. We show that the recent Embarrassingly Parallel Search method (EPS) can be used for this purpose. EPS proposes to…

Artificial Intelligence · Computer Science 2016-04-25 Anthony Palmieri , Jean-Charles Régin , Pierre Schaus

Machine-learning-based entity resolution has been widely studied. However, some entity pairs may be mislabeled by machine learning models and existing studies do not study the risk analysis problem -- predicting and interpreting which…

Databases · Computer Science 2019-12-09 Zhaoqiang Chen , Qun Chen , Boyi Hou , Tianyi Duan , Zhanhuai Li , Guoliang Li

There has been substantial recent interest in record linkage, attempting to group the records pertaining to the same entities from a large database lacking unique identifiers. This can be viewed as a type of "microclustering," with few…

Statistics Theory · Mathematics 2017-03-16 James E. Johndrow , Kristian Lum , David B. Dunson

The goal of entity matching is to find the corresponding records representing the same real-world entity from different data sources. At present, in the mainstream methods, rule-based entity matching methods need tremendous domain…

Machine Learning · Computer Science 2024-03-25 Youfang Han , Chunping Li

Entity matching is the task of deciding whether two entity descriptions refer to the same real-world entity. Entity matching is a central step in most data integration pipelines. Many state-of-the-art entity matching methods rely on…

Computation and Language · Computer Science 2024-10-21 Ralph Peeters , Aaron Steiner , Christian Bizer

Accurate and efficient entity resolution (ER) has been a problem in data analysis and data mining projects for decades. In our work, we are interested in developing ER methods to handle big data. Good public datasets are restricted in this…

Methodology · Statistics 2020-09-08 Samudra Herath , Matthew Roughan , Gary Glonek

Multipartite entity resolution aims at integrating records from multiple datasets into one entity. We derive a mathematical formulation for a general class of record linkage problems in multipartite entity resolution across many datasets as…

Discrete Mathematics · Computer Science 2021-12-08 Alla Kammerdiner , Alexander Semenov , Eduardo Pasiliao

The same real-world entity (e.g., a movie, a restaurant, a person) may be described in various ways on different datasets. Entity Resolution (ER) aims to find such different descriptions of the same entity, this way improving data quality…

Databases · Computer Science 2025-03-18 Konstantinos Nikoletos , Vasilis Efthymiou , George Papadakis , Kostas Stefanidis

In this paper, we present ASPEN, an answer set programming (ASP) implementation of a recently proposed declarative framework for collective entity resolution (ER). While an ASP encoding had been previously suggested, several practical…

Entity Resolution (ER) aims to identify whether two tuples refer to the same real-world entity and is well-known to be labor-intensive. It is a prerequisite to anomaly detection, as comparing the attribute values of two matched tuples from…

Databases · Computer Science 2021-09-03 Congcong Ge , Pengfei Wang , Lu Chen , Xiaoze Liu , Baihua Zheng , Yunjun Gao