English
Related papers

Related papers: Regression Modeling and File Matching Using Possib…

200 papers

Bayesian model comparison is often based on the posterior distribution over the set of compared models. This distribution is often observed to concentrate on a single model even when other measures of model fit or forecasting ability…

Statistics Theory · Mathematics 2020-03-10 Oscar Oelrich , Shutong Ding , Måns Magnusson , Aki Vehtari , Mattias Villani

When the data do not conform to the hypothesis of a known sampling-variance, the fitting of a constant to a set of measured values is a long debated problem. Given the data, fitting would require to find what measurand value is the most…

Data Analysis, Statistics and Probability · Physics 2020-07-21 Giovanni Mana , Enrico Massa , Maria Predescu

Probabilistic record linkage is often used to match records from two files, in particular when the variables common to both files comprise imperfectly measured identifiers like names and demographic variables. We consider bipartite record…

Methodology · Statistics 2023-12-06 Eric A. Bai , Olivier Binette , Jerome P. Reiter

Missing values are unavoidable in many applications of machine learning and present challenges both during training and at test time. When variables are missing in recurring patterns, fitting separate pattern submodels have been proposed as…

Machine Learning · Computer Science 2023-11-27 Lena Stempfle , Ashkan Panahi , Fredrik D. Johansson

International comparisons of hierarchical time series data sets based on survey data, such as annual country-level estimates of school enrollment rates, can suffer from large amounts of missing data due to differing coverage of surveys…

Methodology · Statistics 2025-03-31 Daphne H. Liu , Adrian E. Raftery

The statistical matching problem is a data integration problem with structured missing data. The general form involves the analysis of multiple datasets that only have a strict subset of variables jointly observed across all datasets. The…

Methodology · Statistics 2019-04-01 Daniel Ahfock , Saumyadipta Pyne , Geoffrey J. McLachlan

We consider comparisons of statistical learning algorithms using multiple data sets, via leave-one-in cross-study validation: each of the algorithms is trained on one data set; the resulting model is then validated on each remaining data…

Applications · Statistics 2015-06-02 Lorenzo Trippa , Levi Waldron , Curtis Huttenhower , Giovanni Parmigiani

For many classification and regression problems, a large number of features are available for possible use - this is typical of DNA microarray data on gene expression, for example. Often, for computational or other reasons, only a small…

Statistics Theory · Mathematics 2007-06-13 Longhai Li , Jianguo Zhang , Radford M. Neal

When estimating causal effects using observational data, it is desirable to replicate a randomized experiment as closely as possible by obtaining treated and control groups with similar covariate distributions. This goal can often be…

Methodology · Statistics 2010-10-28 Elizabeth A. Stuart

Hierarchical models are increasingly used in many applications. Along with this increased use comes a desire to investigate whether the model is compatible with the observed data. Bayesian methods are well suited to eliminate the many…

Methodology · Statistics 2008-02-08 M. J. Bayarri , M. E. Castellanos

Food authenticity studies are concerned with determining if food samples have been correctly labeled or not. Discriminant analysis methods are an integral part of the methodology for food authentication. Motivated by food authenticity…

Methodology · Statistics 2010-10-08 Thomas Brendan Murphy , Nema Dean , Adrian E. Raftery

For the binary regression, the use of symmetrical link functions are not appropriate when we have evidence that the probability of success increases at a different rate than decreases. In these cases, the use of link functions based on the…

Methodology · Statistics 2024-07-23 João Victor B. de Freitas , Caio L. N. Azevedo

We introduce a general framework for regression in the errors-in-variables regime, allowing for full flexibility about the dimensionality of the data, observational error probability density types, the (nonlinear) model type and the…

Methodology · Statistics 2024-11-19 Wolfgang Hoegele , Sarah Brockhaus

In the information age, it has become increasingly common for data containing records about overlapping individuals to be distributed across multiple sources, making it necessary to identify which records refer to the same individual. The…

Methodology · Statistics 2025-06-09 L. Drew , A. Kaplan , I. Breckheimer

Approximate string-matching methods to account for complex variation in highly discriminatory text fields, such as personal names, can enhance probabilistic record linkage. However, discriminating between matching and non-matching strings…

Information Retrieval · Computer Science 2020-01-08 Philip A. Collender , Zhiyue Tom Hu , Charles Li , Qu Cheng , Xintong Li , Yue You , Song Liang , Changhong Yang , Justin V. Remais

In practical data integration systems, it is common for the data sources being integrated to provide conflicting information about the same entity. Consequently, a major challenge for data integration is to derive the most complete and…

Databases · Computer Science 2012-03-05 Bo Zhao , Benjamin I. P. Rubinstein , Jim Gemmell , Jiawei Han

Hierarchical model fitting has become commonplace for case-control studies of cognition and behaviour in mental health. However, these techniques require us to formalise assumptions about the data-generating process at the group level,…

Computers and Society · Computer Science 2020-11-04 Vincent Valton , Toby Wise , Oliver J. Robinson

Record linkage (de-duplication or entity resolution) is the process of merging noisy databases to remove duplicate entities. While record linkage removes duplicate entities from such databases, the downstream task is any inferential,…

Methodology · Statistics 2018-10-12 Rebecca C. Steorts , Andrea Tancredi , Brunero Liseo

Modern statistical applications involving large data sets have focused attention on statistical methodologies which are both efficient computationally and able to deal with the screening of large numbers of different candidate models. Here…

Methodology · Statistics 2014-02-26 David J. Nott , Minh-Ngoc Tran , Chenlei Leng

Mixed data refers to a type of data in which variables can be of multiple types, such as continuous, discrete, or categorical. This data is routinely collected in various fields, including healthcare and social sciences. A common goal in…

Methodology · Statistics 2025-05-22 Mauro Florez , Anna Gottard , Carrie McAdams , Michele Guindani , Marina Vannucci