English
Related papers

Related papers: Solving high-dimensional parameter inference: marg…

200 papers

We propose a method for inference on moderately high-dimensional, nonlinear, non-Gaussian, partially observed Markov process models for which the transition density is not analytically tractable. Markov processes with intractable transition…

Methodology · Statistics 2020-04-02 Joonha Park , Edward L. Ionides

Solving high-dimensional Bayesian inverse problems (BIPs) with the variational inference (VI) method is promising but still challenging. The main difficulties arise from two aspects. First, VI methods approximate the posterior distribution…

Numerical Analysis · Mathematics 2023-02-23 Yingzhi Xia , Qifeng Liao , Jinglai Li

It is now practically the norm for data to be very high dimensional in areas such as genetics, machine vision, image analysis and many others. When analyzing such data, parametric models are often too inflexible while nonparametric…

Methodology · Statistics 2011-05-31 Abhishek Bhattacharya , Garritt Page , David Dunson

The problem of detecting a sinusoidal signal with randomly varying frequency has a long history. It is one of the core problems in signal processing, arising in many applications including, for example, underwater acoustic frequency line…

Signal Processing · Electrical Eng. & Systems 2022-11-16 Changrong Liu , S. Suvorova , R. J. Evans , B. Moran , A. Melatos

Solving ill-posed inverse problems by Bayesian inference has recently attracted considerable attention. Compared to deterministic approaches, the probabilistic representation of the solution by the posterior distribution can be exploited to…

Numerical Analysis · Mathematics 2016-11-03 Felix Lucka

This paper presents an improved implicit sampling method for hierarchical Bayesian inverse problems. A widely used approach for sampling posterior distribution is based on Markov chain Monte Carlo (MCMC). However, the samples generated by…

Numerical Analysis · Mathematics 2018-11-27 Xiaoyan Song , Lijian Jiang , Guanghui Zheng

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

Many statistical models in cosmology can be simulated forwards but have intractable likelihood functions. Likelihood-free inference methods allow us to perform Bayesian inference from these models using only forward simulations, free from…

Cosmology and Nongalactic Astrophysics · Physics 2018-04-11 Justin Alsing , Benjamin Wandelt , Stephen Feeney

We apply recent advances in machine learning and computer vision to a central problem in materials informatics: The statistical representation of microstructural images. We use activations in a pre-trained convolutional neural network to…

Computational Physics · Physics 2018-12-04 Nicholas Lubbers , Turab Lookman , Kipton Barros

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

Statistics Theory · Mathematics 2010-01-13 Yuan Liao , Wenxin Jiang

In recent years, diffusion models, and more generally score-based deep generative models, have achieved remarkable success in various applications, including image and audio generation. In this paper, we view diffusion models as an implicit…

Statistics Theory · Mathematics 2026-02-12 Hyeok Kyu Kwon , Dongha Kim , Ilsang Ohn , Minwoo Chae

We consider linear regression problems with a varying number of random projections, where we provably exhibit a double descent curve for a fixed prediction problem, with a high-dimensional analysis based on random matrix theory. We first…

Machine Learning · Computer Science 2023-03-15 Francis Bach

The machine learning community has recently put effort into quantized or low-precision arithmetics to scale large models. This paper proposes performing probabilistic inference in the quantized, discrete parameter space created by these…

Machine Learning · Computer Science 2025-08-20 Aleksanteri Sladek , Martin Trapp , Arno Solin

In this work we address the problem of approximating high-dimensional data with a low-dimensional representation. We make the following contributions. We propose an inverse regression method which exchanges the roles of input and response,…

Machine Learning · Computer Science 2015-09-04 Antoine Deleforge , Florence Forbes , Radu Horaud

Deep neural networks are increasingly being used in cognitive modeling as a means of deriving representations for complex stimuli such as images. While the predictive power of these networks is high, it is often not clear whether they also…

Neurons and Cognition · Quantitative Biology 2020-06-01 Aditi Jha , Joshua Peterson , Thomas L. Griffiths

Analyzing time series in the frequency domain enables the development of powerful tools for investigating the second-order characteristics of multivariate processes. Parameters like the spectral density matrix and its inverse, the coherence…

Methodology · Statistics 2024-01-19 Jonas Krampe , Efstathios Paparoditis

We present a multi-fidelity method for uncertainty quantification of parameter estimates in complex systems, leveraging generative models trained to sample the target conditional distribution. In the Bayesian inference setting, traditional…

Machine Learning · Computer Science 2025-04-03 Caroline Tatsuoka , Minglei Yang , Dongbin Xiu , Guannan Zhang

Gravitational waves from compact binaries measured by the LIGO and Virgo detectors are routinely analyzed using Markov Chain Monte Carlo sampling algorithms. Because the evaluation of the likelihood function requires evaluating millions of…

Instrumentation and Methods for Astrophysics · Physics 2020-12-23 Arnaud Delaunoy , Antoine Wehenkel , Tanja Hinderer , Samaya Nissanke , Christoph Weniger , Andrew R. Williamson , Gilles Louppe

We describe a numerical scheme for evaluating the posterior moments of Bayesian linear regression models with partial pooling of the coefficients. The principal analytical tool of the evaluation is a change of basis from coefficient space…

Computation · Statistics 2021-10-01 Philip Greengard , Andrew Gelman , Aki Vehtari

In this paper, we propose an efficient pseudo-marginal Markov chain Monte Carlo (MCMC) sampling approach to draw samples from posterior shape distributions for image segmentation. The computation time of the proposed approach is independent…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Ertunc Erdil , Sinan Yildirim , Tolga Tasdizen , Mujdat Cetin