English
Related papers

Related papers: Record Linkage to Match Customer Names: A Probabil…

200 papers

The task of matching co-referent records is known among other names as rocord linkage. For large record-linkage problems, often there is little or no labeled data available, but unlabeled data shows a reasonable clear structure. For such…

Machine Learning · Computer Science 2012-07-19 Pradeep Ravikumar , William Cohen

We consider the problem of aligning a pair of databases with correlated entries. We introduce a new measure of correlation in a joint distribution that we call cycle mutual information. This measure has operational significance: it…

Information Theory · Computer Science 2018-05-11 Daniel Cullina , Prateek Mittal , Negar Kiyavash

The relevance between a query and a document in search can be represented as matching degree between the two objects. Latent space models have been proven to be effective for the task, which are often trained with click-through data. One…

Information Retrieval · Computer Science 2016-04-22 Shuxin Wang , Xin Jiang , Hang Li , Jun Xu , Bin Wang

Labeling patients in electronic health records with respect to their statuses of having a disease or condition, i.e. case or control statuses, has increasingly relied on prediction models using high-dimensional variables derived from…

Methodology · Statistics 2021-10-14 Zijian Guo , Prabrisha Rakshit , Daniel S. Herman , Jinbo Chen

We address the problem of learning a distributed representation of entities in a relational database using a low-dimensional embedding. Low-dimensional embeddings aim to encapsulate a concise vector representation for an underlying dataset…

Databases · Computer Science 2020-05-14 Siddhant Arora , Srikanta Bedathur

Large Language Models (LLMs) have shown useful applications in a variety of tasks, including data wrangling. In this paper, we investigate the use of an off-the-shelf LLM for schema matching. Our objective is to identify semantic…

Databases · Computer Science 2024-07-17 Marcel Parciak , Brecht Vandevoort , Frank Neven , Liesbet M. Peeters , Stijn Vansummeren

We consider the problem of creating a navigation structure that allows a user to most effectively navigate a data lake. We define an organization as a graph that contains nodes representing sets of attributes within a data lake and edges…

Databases · Computer Science 2020-03-04 Fatemeh Nargesian , Ken Q. Pu , Bahar Ghadiri Bashardoost , Erkang Zhu , Renée J. Miller

When compiling databases, for example to meet the needs of healthcare establishments, there is quite a common problem with the introduction and further processing of names and last names of doctors and patients that are highly specialized…

Computation and Language · Computer Science 2019-11-04 V. Buriachok , M. Hadzhyiev , V. Sokolov , P. Skladannyi , L. Kuzmenko

We consider the evaluation of approximate top-k queries from relations with a-priori unknown values. Such relations can arise for example in the context of expensive predicates, or cloud-based data sources. The task is to find an…

Databases · Computer Science 2010-08-31 Antti Ukkonen

Process mining leverages event data extracted from IT systems to generate insights into the business processes of organizations. Such insights benefit from explicitly considering the frequency of behavior in business processes, which is…

Formal Languages and Automata Theory · Computer Science 2025-07-10 Tian Li , Artem Polyvyanyy , Sander J. J. Leemans

We consider the problem of duplicate detection in noisy and incomplete data: given a large data set in which each record has multiple entries (attributes), detect which distinct records refer to the same real world entity. This task is…

Databases · Computer Science 2019-07-11 Yves van Gennip , Blake Hunter , Anna Ma , Daniel Moyer , Ryan de Vera , Andrea L. Bertozzi

Combining data from various sources empowers researchers to explore innovative questions, for example those raised by conducting healthcare monitoring studies. However, the lack of a unique identifier often poses challenges. Record linkage…

Methodology · Statistics 2025-09-16 Kayané Robach , Stéphanie L van der Pas , Mark A van de Wiel , Michel H Hof

Tables on the Web contain a vast amount of knowledge in a structured form. To tap into this valuable resource, we address the problem of table retrieval: answering an information need with a ranked list of tables. We investigate this…

Information Retrieval · Computer Science 2021-05-14 Shuo Zhang , Krisztian Balog

Address matching is an important task for many businesses especially delivery and take out companies which help them to take out a certain address from their data warehouse. Existing solution uses similarity of strings, and edit distance…

Computation and Language · Computer Science 2024-04-19 Vansh Gupta , Mohit Gupta , Jai Garg , Nitesh Garg

This paper deals with the binary classification task when the target class has the lower probability of occurrence. In such situation, it is not possible to build a powerful classifier by using standard methods such as logistic regression,…

Machine Learning · Statistics 2015-02-26 Cheikh Ndour , Aliou Diop , Simplice Dossou-Gbété

Traditional Relational Topic Models provide a way to discover the hidden topics from a document network. Many theoretical and practical tasks, such as dimensional reduction, document clustering, link prediction, benefit from this revealed…

Machine Learning · Statistics 2015-03-31 Junyu Xuan , Jie Lu , Guangquan Zhang , Richard Yi Da Xu , Xiangfeng Luo

Data mining is the task of discovering interesting patterns from large amounts of data. There are many data mining tasks, such as classification, clustering, association rule mining, and sequential pattern mining. Sequential pattern mining…

Databases · Computer Science 2010-02-08 Mahdi Esmaeili , Fazekas Gabor

Foundation models, particularly those that incorporate Transformer architectures, have demonstrated exceptional performance in domains such as natural language processing and image processing. Adapting these models to structured data, like…

Machine Learning · Computer Science 2025-01-08 Tassilo Klein , Clemens Biehl , Margarida Costa , Andre Sres , Jonas Kolk , Johannes Hoffart

We study the complexity of various fundamental counting problems that arise in the context of incomplete databases, i.e., relational databases that can contain unknown values in the form of labeled nulls. Specifically, we assume that the…

Databases · Computer Science 2021-04-29 Marcelo Arenas , Pablo Barceló , Mikaël Monet

Landmarks have long played a pivotal role in automated planning, serving as crucial elements for improving the planning algorithms. The main limitation of classical landmark extraction methods is their sensitivity to specific planning…

Artificial Intelligence · Computer Science 2025-09-23 Cristian Pérez-Corral , Antonio Garrido , Laura Sebastia