English
Related papers

Related papers: Computational aspects of Bayesian spectral density…

200 papers

Spectral estimation (SE) aims to identify how the energy of a signal (e.g., a time series) is distributed across different frequencies. This can become particularly challenging when only partial and noisy observations of the signal are…

Machine Learning · Statistics 2019-01-15 Felipe Tobar

The PAC-Bayesian approach is a powerful set of techniques to derive non- asymptotic risk bounds for random estimators. The corresponding optimal distribution of estimators, usually called the Gibbs posterior, is unfortunately intractable.…

Machine Learning · Statistics 2015-06-16 Pierre Alquier , James Ridgway , Nicolas Chopin

Sparse Bayesian factor models are routinely implemented for parsimonious dependence modeling and dimensionality reduction in high-dimensional applications. We provide theoretical understanding of such Bayesian procedures in terms of…

Statistics Theory · Mathematics 2014-06-03 Debdeep Pati , Anirban Bhattacharya , Natesh S. Pillai , David Dunson

In this paper we show that the classical problem of frequency estimation can be formulated and solved efficiently in an empirical Bayesian framework by assigning a uniform a priori probability distribution to the unknown frequency. We…

Signal Processing · Electrical Eng. & Systems 2020-10-27 Giorgio Picci , Bin Zhu

In Bayesian inverse problems, it is common to consider several hyperparameters that define the prior and the noise model that must be estimated from the data. In particular, we are interested in linear inverse problems with additive…

Numerical Analysis · Mathematics 2024-12-05 Julianne Chung , Scot M. Miller , Malena Sabate Landman , Arvind K. Saibaba

In Bayesian inverse problems, the posterior distribution is used to quantify uncertainty about the reconstructed solution. In practice, Markov chain Monte Carlo algorithms often are used to draw samples from the posterior distribution.…

Numerical Analysis · Mathematics 2018-03-13 D. Andrew Brown , Arvind Saibaba , Sarah Vallélian

Bayesian methods are appealing in their flexibility in modeling complex data and ability in capturing uncertainty in parameters. However, when Bayes' rule does not result in tractable closed-form, most approximate inference algorithms lack…

Machine Learning · Computer Science 2016-05-09 Bo Dai , Niao He , Hanjun Dai , Le Song

We study the rate of convergence of posterior distributions in density estimation problems for log-densities in periodic Sobolev classes characterized by a smoothness parameter p. The posterior expected density provides a nonparametric…

Statistics Theory · Mathematics 2009-09-29 Catia Scricciolo

Sequential techniques can enhance the efficiency of the approximate Bayesian computation algorithm, as in Sisson et al.'s (2007) partial rejection control version. While this method is based upon the theoretical works of Del Moral et al.…

Computation · Statistics 2010-10-11 Mark A. Beaumont , Jean-Marie Cornuet , Jean-Michel Marin , Christian P. Robert

The statistical inverse problem of estimating the probability distribution of an infinite-dimensional unknown given its noisy indirect observation is studied in the Bayesian framework. In practice, one often considers only…

Statistics Theory · Mathematics 2017-11-21 Sari Lasanen

We consider the problem of approximate Bayesian parameter inference in non-linear state-space models with intractable likelihoods. Sequential Monte Carlo with approximate Bayesian computations (SMC-ABC) is one approach to approximate the…

Computation · Statistics 2017-06-14 Johan Dahlin , Mattias Villani , Thomas B. Schön

We study a nonparametric Bayesian approach to linear inverse problems under discrete observations. We use the discrete Fourier transform to convert our model into a truncated Gaussian sequence model, that is closely related to the classical…

Statistics Theory · Mathematics 2018-10-31 Shota Gugushvili , Aad van der Vaart , Dong Yan

We consider Bayesian inverse problems arising in data assimilation for dynamical systems governed by partial and stochastic partial differential equations. The space-time dependent field is inferred jointly with static parameters of the…

Computation · Statistics 2026-03-20 Baptiste Simandoux , Nikolas Kantas , Dan Crisan

In recent years, the shortcomings of Bayesian posteriors as inferential devices have received increased attention. A popular strategy for fixing them has been to instead target a Gibbs measure based on losses that connect a parameter of…

Statistics Theory · Mathematics 2025-04-24 David T. Frazier , Jeremias Knoblauch , Jack Jewson , Christopher Drovandi

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

Machine Learning · Statistics 2015-03-23 Yarin Gal , Richard Turner

We study the sample complexity of Bayesian recovery for solving inverse problems with general prior, forward operator and noise distributions. We consider posterior sampling according to an approximate prior $\mathcal{P}$, and establish…

Machine Learning · Computer Science 2025-12-02 Ben Adcock , Nick Huang

The prominent Bernstein -- von Mises (BvM) result claims that the posterior distribution after centering by the efficient estimator and standardizing by the square root of the total Fisher information is nearly standard normal. In…

Statistics Theory · Mathematics 2020-06-02 Vladimir Spokoiny , Maxim Panov

One of the fundamental problems in Bayesian statistics is the approximation of the posterior distribution. Gibbs sampler and coordinate ascent variational inference are renownedly utilized approximation techniques that rely on stochastic…

Statistics Theory · Mathematics 2021-06-18 Se Yoon Lee

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

Approximate Bayesian Computation is a family of likelihood-free inference techniques that are well-suited to models defined in terms of a stochastic generating mechanism. In a nutshell, Approximate Bayesian Computation proceeds by computing…

Computation · Statistics 2010-07-28 Michael Blum