English
Related papers

Related papers: Practical Bayesian Inference for Record Linkage

200 papers

We propose a probabilistic framework to directly insert prior knowledge in reinforcement learning (RL) algorithms by defining the behaviour policy as a Bayesian posterior distribution. Such a posterior combines task specific information…

Machine Learning · Computer Science 2018-10-02 Michalis K. Titsias , Sotirios Nikoloutsopoulos

Learning a sequence of tasks without access to i.i.d. observations is a widely studied form of continual learning (CL) that remains challenging. In principle, Bayesian learning directly applies to this setting, since recursive and one-off…

In this paper we present a synthesis of the work performed on two inference algorithms: the Pearl's belief propagation (BP) algorithm applied to Bayesian networks without loops (i.e. polytree) and the Loopy belief propagation (LBP)…

Artificial Intelligence · Computer Science 2012-06-06 Amen Ajroud , Mohamed Nazih Omri , Habib Youssef , Salem Benferhat

Entity resolution (ER), comprising record linkage and de-duplication, is the process of merging noisy databases in the absence of unique identifiers to remove duplicate entities. One major challenge of analysis with linked data is…

Methodology · Statistics 2022-02-10 Andee Kaplan , Brenda Betancourt , Rebecca C. Steorts

Bayesian Personalized Ranking (BPR), a collaborative filtering approach based on matrix factorization, frequently serves as a benchmark for recommender systems research. However, numerous studies often overlook the nuances of BPR…

Information Retrieval · Computer Science 2024-10-21 Aleksandr Milogradskii , Oleg Lashinin , Alexander P , Marina Ananyeva , Sergey Kolesnikov

Entity resolution (ER; also known as record linkage or de-duplication) is the process of merging noisy databases, often in the absence of unique identifiers. A major advancement in ER methodology has been the application of Bayesian…

Some machine learning applications require continual learning - where data comes in a sequence of datasets, each is used for training and then permanently discarded. From a Bayesian perspective, continual learning seems straightforward:…

Machine Learning · Statistics 2019-02-19 Sebastian Farquhar , Yarin Gal

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Partial Multi-label Learning (PML) is a type of weakly supervised learning where each training instance corresponds to a set of candidate labels, among which only some are true. In this paper, we introduce \our{}, a novel probabilistic…

Machine Learning · Computer Science 2024-03-13 Łukasz Struski , Adam Pardyl , Jacek Tabor , Bartosz Zieliński

The problem of merging databases arises in many government and commercial applications. Schema matching, a common first step, identifies equivalent fields between databases. We introduce a schema matching framework that builds nonparametric…

Information Retrieval · Computer Science 2015-07-07 Erik M. Ferragut , Jason Laska

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

To effectively perform the task of next-word prediction, long short-term memory networks (LSTMs) must keep track of many types of information. Some information is directly related to the next word's identity, but some is more secondary…

Computation and Language · Computer Science 2021-06-01 Qingfeng Lan , Luke Kumar , Martha White , Alona Fyshe

Models with intractable likelihood functions arise in areas including network analysis and spatial statistics, especially those involving Gibbs random fields. Posterior parameter es timation in these settings is termed a doubly-intractable…

Computation · Statistics 2018-10-16 Lampros Bouranis , Nial Friel , Florian Maire

The problem of matching unlabelled point sets using Bayesian inference is considered. Two recently proposed models for the likelihood are compared, based on the Procrustes size-and-shape and the full configuration. Bayesian inference is…

Computation · Statistics 2010-09-17 Kim Kenobi , Ian L. Dryden

Performing exact posterior inference in complex generative models is often difficult or impossible due to an expensive to evaluate or intractable likelihood function. Approximate Bayesian computation (ABC) is an inference framework that…

Machine Learning · Statistics 2016-02-16 Jovana Mitrovic , Dino Sejdinovic , Yee Whye Teh

The rising interest in Bayesian deep learning (BDL) has led to a plethora of methods for estimating the posterior distribution. However, efficient computation of inferences, such as predictions, has been largely overlooked with Monte Carlo…

Machine Learning · Computer Science 2025-07-23 Rui Li , Marcus Klasson , Arno Solin , Martin Trapp

Probabilistic record linkage is often used to match records from two files, in particular when the variables common to both files comprise imperfectly measured identifiers like names and demographic variables. We consider bipartite record…

Methodology · Statistics 2023-12-06 Eric A. Bai , Olivier Binette , Jerome P. Reiter

Linear programming is widely used for decision-making in science, engineering, and operations research, yet in many modern applications the coefficients entering the constraints and objective are not known exactly and must be learned from…

Other Statistics · Statistics 2026-03-09 Debashis Chatterjee

In many settings, a data curator links records from two files to produce datasets that are shared with secondary analysts. Analysts use the linked files to estimate models of interest, such as regressions. Such two-stage approaches do not…

Methodology · Statistics 2025-11-18 Xueyan Hu , Jerome P. Reiter

Bayesian inference typically relies on specifying a parametric model that approximates the data-generating process. However, misspecified models can yield poor convergence rates and unreliable posterior calibration. Bayesian empirical…

Methodology · Statistics 2025-10-27 Kenyon Ng , Weichang Yu , Howard D. Bondell