English
Related papers

Related papers: Scaling Bayesian Probabilistic Record Linkage with…

200 papers

Probabilistic record linkage (PRL) is the process of determining which records in two databases correspond to the same underlying entity in the absence of a unique identifier. Bayesian solutions to this problem provide a powerful mechanism…

Methodology · Statistics 2017-12-05 Brendan S. McVeigh , Jared S. Murray

Researchers are often interested in linking individuals between two datasets that lack a common unique identifier. Matching procedures often struggle to match records with common names, birthplaces or other field values. Computational…

Methodology · Statistics 2021-06-14 Thomas Stringham

In record linkage (RL), or exact file matching, the goal is to identify the links between entities with information on two or more files. RL is an important activity in areas including counting the population, enhancing survey frames and…

Statistics Theory · Mathematics 2012-12-21 Michael D. Larsen

Privacy-preserving record linkage (PPRL), the problem of identifying records that correspond to the same real-world entity across several data sources held by different parties without revealing any sensitive information about these…

Databases · Computer Science 2016-12-30 Dinusha Vatsalan , Peter Christen

Given several databases containing person-specific data held by different organizations, Privacy-Preserving Record Linkage (PPRL) aims to identify and link records that correspond to the same entity/individual across different databases…

Databases · Computer Science 2022-12-13 Dinusha Vatsalan , Dimitrios Karapiperis , Vassilios S. Verykios

Private record linkage (PRL) is the problem of identifying pairs of records that are similar as per an input matching rule from databases held by two parties that do not trust one another. We identify three key desiderata that a PRL…

Databases · Computer Science 2017-09-04 Xi He , Ashwin Machanavajjhala , Cheryl Flynn , Divesh Srivastava

Databases often contain corrupted, degraded, and noisy data with duplicate entries across and within each database. Such problems arise in citations, medical databases, genetics, human rights databases, and a variety of other applied…

Methodology · Statistics 2015-04-29 Rebecca C. Steorts

Deep learning-based linkage of records across different databases is becoming increasingly useful in data integration and mining applications to discover new insights from multiple sources of data. However, due to privacy and…

Cryptography and Security · Computer Science 2022-11-07 Thilina Ranbaduge , Dinusha Vatsalan , Ming Ding

Privacy-Preserving Record linkage (PPRL) is an essential component in data integration tasks of sensitive information. The linkage quality determines the usability of combined datasets and (machine learning) applications based on them. We…

Cryptography and Security · Computer Science 2025-07-08 Florens Rohde , Victor Christen , Martin Franke , Erhard Rahm

We propose an unsupervised approach for linking records across arbitrarily many files, while simultaneously detecting duplicate records within files. Our key innovation involves the representation of the pattern of links between records as…

Methodology · Statistics 2015-11-03 Rebecca C. Steorts , Rob Hall , Stephen E. Fienberg

Data cleaning is naturally framed as probabilistic inference in a generative model of ground-truth data and likely errors, but the diversity of real-world error patterns and the hardness of inference make Bayesian approaches difficult to…

Machine Learning · Computer Science 2022-11-22 Alexander K. Lew , Monica Agrawal , David Sontag , Vikash K. Mansinghka

In theory, the probabilistic linkage method provides two distinct advantages over non-probabilistic methods, including minimal rates of linkage error and accurate measures of these rates for data users. However, implementations can fall…

Methodology · Statistics 2019-11-06 Abel Dasylva , Arthur Goussanou , David Ajavon , Hanan Abousaleh

Privacy-preserving record linkage (PPRL) aims at integrating sensitive information from multiple disparate databases of different organizations. PPRL approaches are increasingly required in real-world application areas such as healthcare,…

Databases · Computer Science 2017-01-06 Dinusha Vatsalan , Peter Christen , Erhard Rahm

Probabilistic record linkage, the task of merging two or more databases in the absence of a unique identifier, is a perennial and challenging problem. It is closely related to the problem of deduplicating a single database, which can be…

Methodology · Statistics 2016-03-28 Jared S. Murray

The bipartite record linkage task consists of merging two disparate datafiles containing information on two overlapping sets of entities. This is non-trivial in the absence of unique identifiers and it is important for a wide variety of…

Methodology · Statistics 2016-01-26 Mauricio Sadinle

Privacy-Preserving Record Linkage (PPRL) supports the integration of sensitive information from multiple datasets, in particular the privacy-preserving matching of records referring to the same entity. PPRL has gained much attention in many…

Databases · Computer Science 2019-12-02 Dinusha Vatsalan , Peter Christen , Erhard Rahm

Merging datafiles containing information on overlapping sets of entities is a challenging task in the absence of unique identifiers, and is further complicated when some entities are duplicated in the datafiles. Most approaches to this…

Methodology · Statistics 2021-10-11 Serge Aleshin-Guendel , Mauricio Sadinle

We propose a novel unsupervised approach for linking records across arbitrarily many files, while simultaneously detecting duplicate records within files. Our key innovation is to represent the pattern of links between records as a {\em…

Computation · Statistics 2014-03-04 Rebecca C. Steorts , Rob Hall , Stephen E. Fienberg

Record linkage (de-duplication or entity resolution) is the process of merging noisy databases to remove duplicate entities. While record linkage removes duplicate entities from such databases, the downstream task is any inferential,…

Methodology · Statistics 2018-10-12 Rebecca C. Steorts , Andrea Tancredi , Brunero Liseo

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly asking about relevancy, such as ``How relevant is document A to…

Information Retrieval · Computer Science 2024-04-19 Le Yan , Zhen Qin , Honglei Zhuang , Rolf Jagerman , Xuanhui Wang , Michael Bendersky , Harrie Oosterhuis
‹ Prev 1 2 3 10 Next ›