English
Related papers

Related papers: Record Linkage to Match Customer Names: A Probabil…

200 papers

Deep learning-based linkage of records across different databases is becoming increasingly useful in data integration and mining applications to discover new insights from multiple sources of data. However, due to privacy and…

Cryptography and Security · Computer Science 2022-11-07 Thilina Ranbaduge , Dinusha Vatsalan , Ming Ding

Probabilistic record linkage is often used to match records from two files, in particular when the variables common to both files comprise imperfectly measured identifiers like names and demographic variables. We consider bipartite record…

Methodology · Statistics 2023-12-06 Eric A. Bai , Olivier Binette , Jerome P. Reiter

Databases often contain corrupted, degraded, and noisy data with duplicate entries across and within each database. Such problems arise in citations, medical databases, genetics, human rights databases, and a variety of other applied…

Methodology · Statistics 2015-04-29 Rebecca C. Steorts

Relation linking is essential to enable question answering over knowledge bases. Although there are various efforts to improve relation linking performance, the current state-of-the-art methods do not achieve optimal results, therefore,…

Strings form a fundamental data type in computer systems. String searching has been extensively studied since the inception of computer science. Increasingly many applications have to deal with imprecise strings or strings with fuzzy…

Databases · Computer Science 2015-09-30 Sharma V. Thankachan , Manish Patil , Rahul Shah , Sudip Biswas

We study the problem of group linkage: linking records that refer to entities in the same group. Applications for group linkage include finding businesses in the same chain, finding conference attendees from the same affiliation, finding…

Databases · Computer Science 2015-03-03 Pei Li , Xin Luna Dong , Songtao Guo , Andrea Maurino , Divesh Srivastava

We propose an unsupervised approach for linking records across arbitrarily many files, while simultaneously detecting duplicate records within files. Our key innovation involves the representation of the pattern of links between records as…

Methodology · Statistics 2015-11-03 Rebecca C. Steorts , Rob Hall , Stephen E. Fienberg

Databases are widespread, yet extracting relevant data can be difficult. Without substantial domain knowledge, multivariate search queries often return sparse or uninformative results. This paper introduces an approach for searching…

Artificial Intelligence · Computer Science 2017-04-05 Feras Saad , Leonardo Casarsa , Vikash Mansinghka

With the expeditious advancement of information technologies, health-related data presented unprecedented potentials for medical and health discoveries but at the same time significant challenges for machine learning techniques both in…

Machine Learning · Computer Science 2018-11-05 Shuo Yang

Recent trends in information management involve the periodic transcription of data onto secondary devices in a networked environment, and the proper scheduling of these transcriptions is critical for efficient data management. To assist in…

Databases · Computer Science 2007-05-23 Avigdor Gal , Jonathan Eckstein

We propose unifying techniques from probabilistic databases and relational embedding models with the goal of performing complex queries on incomplete and uncertain data. We formalize a probabilistic database model with respect to which all…

Artificial Intelligence · Computer Science 2020-06-30 Tal Friedman , Guy Van den Broeck

In many supervised learning tasks, the entities to be labeled are related to each other in complex ways and their labels are not independent. For example, in hypertext classification, the labels of linked pages are highly correlated. A…

Machine Learning · Computer Science 2013-01-07 Ben Taskar , Pieter Abbeel , Daphne Koller

Recently, prompt-based learning has gained popularity across many natural language processing (NLP) tasks by reformulating them into a cloze-style format to better align pre-trained language models (PLMs) with downstream tasks. However,…

Computation and Language · Computer Science 2023-08-15 Wenjie Zhang , Xiaoning Song , Zhenhua Feng , Tianyang Xu , Xiaojun Wu

Motivated by the need of the linking records across various databases, we propose a novel graphical model based classifier that uses a mixture of Poisson distributions with latent variables. The idea is to derive insight into each pair of…

Machine Learning · Computer Science 2019-08-13 Harish Kashyap K , Kiran Byadarhaly , Saumya Shah

The meaning of a word often varies depending on its usage in different domains. The standard word embedding models struggle to represent this variation, as they learn a single global representation for a word. We propose a method to learn…

Computation and Language · Computer Science 2019-10-22 Lahari Poddar , Gyorgy Szarvas , Lea Frermann

Searching patients based on the relevance of their medical records is challenging because of the inherent implicit knowledge within the patients' medical records and queries. Such knowledge is known to the medical practitioners but may be…

Information Retrieval · Computer Science 2017-02-02 Nut Limsopatham , Craig Macdonald , Iadh Ounis

Recent advances in large language models have revolutionized many sectors, including the database industry. One common challenge when dealing with large volumes of tabular data is the pervasive use of abbreviated column names, which can…

Computation and Language · Computer Science 2023-10-23 Jiani Zhang , Zhengyuan Shen , Balasubramaniam Srinivasan , Shen Wang , Huzefa Rangwala , George Karypis

In this work, we propose a theory for information matching. It is motivated by the observation that retrieval is about the relevance matching between two sets of properties (features), namely, the information need representation and…

Information Retrieval · Computer Science 2012-06-04 Jagadeesh Gorla , Stephen Robertson , Jun Wang , Tamas Jambor

Query answering over probabilistic data is an important task but is generally intractable. However, a new approach for this problem has recently been proposed, based on structural decompositions of input databases, following, e.g., tree…

Databases · Computer Science 2019-08-28 Antoine Amarilli , Silviu Maniu , Mikaël Monet

Past research on probabilistic databases has studied the problem of answering queries on a static database. Application scenarios of probabilistic databases however often involve the conditioning of a database using additional information…

Databases · Computer Science 2008-06-16 Christoph Koch , Dan Olteanu