English
Related papers

Related papers: Automatic tempered posterior distributions for Bay…

200 papers

We consider the prediction of weak effects in a multiple-output regression setup, when covariates are expected to explain a small amount, less than $\approx 1%$, of the variance of the target variables. To facilitate the prediction of the…

Importance sampling algorithms are discussed in detail, with an emphasis on implicit sampling, and applied to data assimilation via particle filters. Implicit sampling makes it possible to use the data to find high-probability samples at…

Computation · Statistics 2015-06-02 Alexandre J. Chorin , Fei Lu , Robert N. Miller , Matthias Morzfeld , Xuemin Tu

Due to their uncertainty quantification, Bayesian solutions to inverse problems are the framework of choice in applications that are risk averse. These benefits come at the cost of computations that are in general, intractable. New advances…

Machine Learning · Computer Science 2024-05-10 Rafael Orozco , Ali Siahkoohi , Mathias Louboutin , Felix J. Herrmann

Sparse representations have proven their efficiency in solving a wide class of inverse problems encountered in signal and image processing. Conversely, enforcing the information to be spread uniformly over representation coefficients…

Machine Learning · Statistics 2017-12-29 Clément Elvira , Pierre Chainais , Nicolas Dobigeon

In this paper we develop a novel approach for estimating large and sparse dynamic factor models using variational inference, also allowing for missing data. Inspired by Bayesian variable selection, we apply slab-and-spike priors onto the…

Methodology · Statistics 2022-10-14 Erik Spånberg

We propose a new empirical Bayes approach for inference in the $p \gg n$ normal linear model. The novelty is the use of data in the prior in two ways, for centering and regularization. Under suitable sparsity assumptions, we establish a…

Statistics Theory · Mathematics 2018-12-06 Ryan Martin , Raymond Mess , Stephen G. Walker

In this paper we develop a new general Bayesian methodology that simultaneously estimates parameters of interest and the marginal likelihood of the model. The proposed methodology builds on Simulated Tempering, which is a powerful algorithm…

Computation · Statistics 2019-06-03 Biljana Jonoska Stojkova , David A. Campbell

We provide a clear and concise introduction to the subjects of inverse problems and data assimilation, and their inter-relations. The first part of our notes covers inverse problems; this refers to the study of how to estimate unknown model…

Methodology · Statistics 2023-02-15 Daniel Sanz-Alonso , Andrew M. Stuart , Armeen Taeb

In Bayesian theory, calculating a posterior probability distribution is highly important but usually difficult. Therefore, some methods have been put forward to deal with such problem, among which, the most popular one is the asymptotic…

Methodology · Statistics 2012-07-20 Zai-Ying Zhou

Mathematical models of real life phenomena are highly nonlinear involving multiple parameters and often exhibiting complex dynamics. Experimental data sets are typically small and noisy, rendering estimation of parameters from such data…

Chaotic Dynamics · Physics 2017-05-11 Abhirup Ghosh , Samit Bhattacharyya , Somdatta Sinha , Amit Apte

Since the turn of the century, approximate Bayesian inference has steadily evolved as new computational techniques have been incorporated to handle increasingly complex and large-scale predictive problems. The recent success of deep neural…

Machine Learning · Statistics 2026-01-14 Roy Shivam Ram Shreshtth , Arnab Hazra , Gourab Mukherjee

Most of the consistency analyses of Bayesian procedures for variable selection in regression refer to pairwise consistency, that is, consistency of Bayes factors. However, variable selection in regression is carried out in a given class of…

Methodology · Statistics 2015-07-30 Elías Moreno , Javier Girón , George Casella

In the context of high-dimensional linear regression models, we propose an algorithm of exact support recovery in the setting of noisy compressed sensing where all entries of the design matrix are independent and identically distributed…

Statistics Theory · Mathematics 2019-10-23 Mohamed Ndaoud , Alexandre B. Tsybakov

This paper proposes a new Bayesian strategy for the smooth estimation of altimetric parameters. The altimetric signal is assumed to be corrupted by a thermal and speckle noise distributed according to an independent and non identically…

Applications · Statistics 2016-04-20 Abderrahim Halimi , Corinne Mailhes , Jean-Yves Tourneret , Hichem Snoussi

In the context of a high-dimensional linear regression model, we propose the use of an empirical correlation-adaptive prior that makes use of information in the observed predictor variable matrix to adaptively address high collinearity,…

Methodology · Statistics 2022-07-04 Chang Liu , Yue Yang , Howard Bondell , Ryan Martin

This paper develops a new empirical Bayesian inference algorithm for solving a linear inverse problem given multiple measurement vectors (MMV) of under-sampled and noisy observable data. Specifically, by exploiting the joint sparsity across…

Numerical Analysis · Mathematics 2021-03-30 Jiahui Zhang , Anne Gelb , Theresa Scarnati

We present a novel Bayesian framework for inverse problems in which the pos terior distribution is interpreted as the intensity measure of a Poisson point process (PPP). The posterior density is approximated using kernel density estimation,…

Numerical Analysis · Mathematics 2025-10-08 Zhiliang Deng , Zhiyuan Wang , Xiaomei Yang , Xiaofei Guan

This paper presents a novel Bayesian strategy for the estimation of smooth signals corrupted by Gaussian noise. The method assumes a smooth evolution of a succession of continuous signals that can have a numerical or an analytical…

Applications · Statistics 2016-02-12 Abderrahim Halimi , Gerald S. Buller , Steve McLaughlin , Paul Honeine

Using a Bayesian approach, we consider the problem of recovering sparse signals under additive sparse and dense noise. Typically, sparse noise models outliers, impulse bursts or data loss. To handle sparse noise, existing methods…

Machine Learning · Statistics 2015-01-13 Martin Sundin , Saikat Chatterjee , Magnus Jansson

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

Machine Learning · Statistics 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang