English
Related papers

Related papers: Prior and Likelihood Choices for Bayesian Matrix F…

200 papers

Bayesian inference typically relies on specifying a parametric model that approximates the data-generating process. However, misspecified models can yield poor convergence rates and unreliable posterior calibration. Bayesian empirical…

Methodology · Statistics 2025-10-27 Kenyon Ng , Weichang Yu , Howard D. Bondell

Identifying small subsets of features that are relevant for prediction and/or classification tasks is a central problem in machine learning and statistics. The feature selection task is especially important, and computationally difficult,…

Statistical Mechanics · Physics 2014-11-04 Charles K. Fisher , Pankaj Mehta

This paper tackles the problem of decomposing binary data using matrix factorization. We consider the family of mean-parametrized Bernoulli models, a class of generative models that are well suited for modeling binary data and enables…

Machine Learning · Computer Science 2022-07-27 Paul Magron , Cédric Févotte

Decision-making often involves ranking and selection. For example, to assemble a team of political forecasters, we might begin by narrowing our choice set to the candidates we are confident rank among the top 10% in forecasting ability.…

Methodology · Statistics 2022-08-04 Dillon Bowen

In this paper, we introduce the notion of Gaussian processes indexed by probability density functions for extending the Mat\'ern family of covariance functions. We use some tools from information geometry to improve the efficiency and the…

Methodology · Statistics 2020-11-09 A. Fradi , Y. Feunteun , C. Samir , M. Baklouti , F. Bachoc , J-M. Loubes

Covariance matrix estimation arises in multivariate problems including multivariate normal sampling models and regression models where random effects are jointly modeled, e.g. random-intercept, random-slope models. A Bayesian analysis of…

Methodology · Statistics 2016-07-14 Ignacio Alvarez , Jarad Niemi , Matt Simpson

We discuss Bayesian inference for parameters selected using the data. First, we provide a critical analysis of the existing positions in the literature regarding the correct Bayesian approach under selection. Second, we propose two types of…

Statistics Theory · Mathematics 2021-05-12 Daniel G. Rasines , G. Alastair Young

Empirical likelihood is a popular nonparametric statistical tool that does not require any distributional assumptions. In this paper, we explore the possibility of conducting variable selection via Bayesian empirical likelihood. We show…

Methodology · Statistics 2022-06-13 Yichen Cheng , Yichuan Zhao

Determining the sensitivity of the posterior to perturbations of the prior and likelihood is an important part of the Bayesian workflow. We introduce a practical and computationally efficient sensitivity analysis approach using importance…

Methodology · Statistics 2024-01-05 Noa Kallioinen , Topi Paananen , Paul-Christian Bürkner , Aki Vehtari

The problem of transformation selection is thoroughly treated from a Bayesian perspective. Several families of transformations are considered with a view to achieving normality: the Box-Cox, the Modulus, the Yeo & Johnson and the Dual…

Methodology · Statistics 2013-12-13 Efstratia Charitidou , Dimitris Fouskakis , Ioannis Ntzoufras

Bayesian hierarchical models are commonly employed for inference in count datasets, as they account for multiple levels of variation by incorporating prior distributions for parameters at different levels. Examples include Beta-Binomial,…

Methodology · Statistics 2024-11-04 Yuexi Wang , Nicholas G. Polson

This paper compares three approaches to the problem of selecting among probability models to fit data (1) use of statistical criteria such as Akaike's information criterion and Schwarz's "Bayesian information criterion," (2) maximization of…

Methodology · Statistics 2016-11-04 William B. Poland , Ross D. Shachter

The main challenges that arise when adopting Gaussian Process priors in probabilistic modeling are how to carry out exact Bayesian inference and how to account for uncertainty on model parameters when making model-based predictions on…

Machine Learning · Statistics 2014-04-08 Maurizio Filippone , Mark Girolami

In many application areas, data are collected on a categorical response and high-dimensional categorical predictors, with the goals being to build a parsimonious model for classification while doing inferences on the important predictors.…

Methodology · Statistics 2013-01-22 Yun Yang , David B. Dunson

Generalized Bayes posterior distributions are formed by putting a fractional power on the likelihood before combining with the prior via Bayes's formula. This fractional power, which is often viewed as a remedy for potential model…

Methodology · Statistics 2023-04-12 Pei-Shien Wu , Ryan Martin

By providing a framework of accounting for the shared ancestry inherent to all life, phylogenetics is becoming the statistical foundation of biology. The importance of model choice continues to grow as phylogenetic models continue to…

Populations and Evolution · Quantitative Biology 2019-02-05 Jamie R. Oaks , Kerry A. Cobb , Vladimir N. Minin , Adam D. Leaché

In this paper we show that there is a link between approximate Bayesian methods and prior robustness. We show that what is typically recognized as an approximation to the likelihood, either due to the simulated data as in the Approximate…

Methodology · Statistics 2020-04-03 Chaitanya Joshi , Fabrizio Ruggeri

Bayesian inference and the use of posterior or posterior predictive probabilities for decision making have become increasingly popular in clinical trials. The current practice in Bayesian clinical trials relies on a hybrid…

Methodology · Statistics 2024-04-30 Shirin Golchi , James Willard

Increasingly complex applications involve large datasets in combination with non-linear and high dimensional mathematical models. In this context, statistical inference is a challenging issue that calls for pragmatic approaches that take…

Data Analysis, Statistics and Probability · Physics 2013-01-31 Andreas Raue , Clemens Kreutz , Fabian Joachim Theis , Jens Timmer

Bayesian matrix factorization (BMF) is a powerful tool for producing low-rank representations of matrices and for predicting missing values and providing confidence intervals. Scaling up the posterior inference for massive-scale matrices is…

Machine Learning · Statistics 2019-02-28 Xiangju Qin , Paul Blomstedt , Eemeli Leppäaho , Pekka Parviainen , Samuel Kaski