English
Related papers

Related papers: An Experiment with Hierarchical Bayesian Record Li…

200 papers

Latent tree analysis seeks to model the correlations among a set of random variables using a tree of latent variables. It was proposed as an improvement to latent class analysis --- a method widely used in social sciences and medicine to…

Machine Learning · Computer Science 2016-10-04 Nevin L. Zhang , Leonard K. M. Poon

Large Language Models (LLMs) have shown useful applications in a variety of tasks, including data wrangling. In this paper, we investigate the use of an off-the-shelf LLM for schema matching. Our objective is to identify semantic…

Databases · Computer Science 2024-07-17 Marcel Parciak , Brecht Vandevoort , Frank Neven , Liesbet M. Peeters , Stijn Vansummeren

Data similarity (or distance) computation is a fundamental research topic which fosters a variety of similarity-based machine learning and data mining applications. In big data analytics, it is impractical to compute the exact similarity of…

Data Structures and Algorithms · Computer Science 2025-03-12 Wei Wu , Bin Li

Data Linkage is an important step that can provide valuable insights for evidence-based decision making, especially for crucial events. Performing sensible queries across heterogeneous databases containing millions of records is a complex…

Databases · Computer Science 2015-10-09 Mohammed Gollapalli

Matching households and individuals across different databases poses challenges due to the lack of unique identifiers, typographical errors, and changes in attributes over time. Record linkage tools play a crucial role in overcoming these…

Applications · Statistics 2024-04-09 Thais Pacheco Menezes , Thomas Brendan Murphy , Michael Fop

Entity matching is the task of linking records from different sources that refer to the same real-world entity. Past work has primarily treated entity linking as a standard supervised learning problem. However, supervised entity matching…

Computation and Language · Computer Science 2024-10-01 Somin Wadhwa , Adit Krishnan , Runhui Wang , Byron C. Wallace , Chris Kong

The goals of Learning Analytics (LA) are manifold, among which helping students to understand their academic progress and improving their learning process, which are at the core of our work. To reach this goal, LA relies on educational…

Databases · Computer Science 2019-07-11 Julie Bu Daher , Armelle Brun , Anne Boyer

Logistic Regression (LR) is a widely used statistical method in empirical binary classification studies. However, real-life scenarios oftentimes share complexities that prevent from the use of the as-is LR model, and instead highlight the…

Machine Learning · Computer Science 2024-05-15 Michela C. Massi , Nicola R. Franco , Francesca Ieva , Andrea Manzoni , Anna Maria Paganoni , Paolo Zunino

Existing file linkage methods may produce sub-optimal results because they consider neither the interactions between different pairs of matched records nor relationships between variables that are exclusive to one of the files. In addition,…

Computation · Statistics 2021-09-28 Edwin Farley , Roee Gutman

Causal representation learning (CRL) models aim to transform high-dimensional data into a latent space, enabling interventions to generate counterfactual samples or modify existing data based on the causal relationships among latent…

Machine Learning · Computer Science 2026-03-19 Alireza Sadeghi , Wael AbdAlmageed

Hierarchical taxonomies are common in many contexts, and they are a very natural structure humans use to organise information. In machine learning, the family of methods that use the 'extra' information is called hierarchical…

Machine Learning · Computer Science 2024-02-01 Ines Nolasco , Dan Stowell

Latent variable models for network data extract a summary of the relational structure underlying an observed network. The simplest possible models subdivide nodes of the network into clusters; the probability of a link between any two nodes…

Machine Learning · Computer Science 2012-07-03 Konstantina Palla , David Knowles , Zoubin Ghahramani

Given two large lists of records, the task in entity resolution (ER) is to find the pairs from the Cartesian product of the lists that correspond to the same real world entity. Typically, passive learning methods on such tasks require large…

Databases · Computer Science 2022-01-19 Arjit Jain , Sunita Sarawagi , Prithviraj Sen

The relevance between a query and a document in search can be represented as matching degree between the two objects. Latent space models have been proven to be effective for the task, which are often trained with click-through data. One…

Information Retrieval · Computer Science 2016-04-22 Shuxin Wang , Xin Jiang , Hang Li , Jun Xu , Bin Wang

There are many issues that can cause problems when attempting to infer model parameters from data. Data and models are both imperfect, and as such there are multiple scenarios in which standard methods of inference will lead to misleading…

Computation · Statistics 2024-05-01 Simon L. Cotter

Large Language Models have undoubtedly revolutionized the Natural Language Processing field, the current trend being to promote one-model-for-all tasks (sentiment analysis, translation, etc.). However, the statistical mechanisms at work in…

Computation and Language · Computer Science 2024-08-26 Célia D'Cruz , Jean-Marc Bereder , Frédéric Precioso , Michel Riveill

Objective: Healthcare data fragmentation presents a major challenge for linking patient data, necessitating robust record linkage to integrate patient records from diverse sources. This study investigates the feasibility of leveraging…

Artificial Intelligence · Computer Science 2025-04-22 Mohammad Beheshti , Lovedeep Gondara , Iris Zachary

Statistical latent class models are widely used in social and psychological researches, yet it is often difficult to establish the identifiability of the model parameters. In this paper we consider the identifiability issue of a family of…

Methodology · Statistics 2016-03-15 Gongjun Xu

Entity linking (mapping ambiguous mentions in text to entities in a knowledge base) is a foundational step in tasks such as knowledge graph construction, question-answering, and information extraction. Our method, LELA, is a modular…

Computation and Language · Computer Science 2026-01-09 Samy Haffoudhi , Fabian M. Suchanek , Nils Holzenberger

This paper considers key challenges to using reinforcement learning (RL) with attack graphs to automate penetration testing in real-world applications from a systems perspective. RL approaches to automated penetration testing are actively…

Cryptography and Security · Computer Science 2022-06-15 Tyler Cody