English
Related papers

Related papers: Approximation and sampling of multivariate probabi…

200 papers

This paper introduces a class of Monte Carlo algorithms which are based upon the simulation of a Markov process whose quasi-stationary distribution coincides with a distribution of interest. This differs fundamentally from, say, current…

Methodology · Statistics 2020-04-14 Murray Pollock , Paul Fearnhead , Adam M. Johansen , Gareth O. Roberts

We construct a new framework for accelerating Markov chain Monte Carlo in posterior sampling problems where standard methods are limited by the computational cost of the likelihood, or of numerical models embedded therein. Our approach…

Methodology · Statistics 2017-01-06 Patrick R. Conrad , Youssef M. Marzouk , Natesh S. Pillai , Aaron Smith

Tensor network states are powerful variational ans\"atze for many-body ground states of quantum lattice models. The use of Monte Carlo sampling techniques in tensor network approaches significantly reduces the cost of tensor contractions,…

Strongly Correlated Electrons · Physics 2012-05-01 Andrew J. Ferris , Guifre Vidal

Reversible jump Markov chain Monte Carlo (RJMCMC) proposals that achieve reasonable acceptance rates and mixing are notoriously difficult to design in most applications. Inspired by recent advances in deep neural network-based normalizing…

Computation · Statistics 2023-02-28 Laurence Davies , Robert Salomone , Matthew Sutton , Christopher Drovandi

Recent advances in IoT and biometric sensing technologies have led to the generation of massive and high-dimensional tensor data, yet achieving accurate and efficient low-rank approximation remains a major challenge. Most existing tensor…

Machine Learning · Computer Science 2025-11-03 Hiroki Hasegawa , Yukihiko Okada

We consider Metropolis Hastings MCMC in cases where the log of the ratio of target distributions is replaced by an estimator. The estimator is based on m samples from an independent online Monte Carlo simulation. Under some conditions on…

Computation · Statistics 2012-06-01 Geoff K. Nicholls , Colin Fox , Alexis Muir Watt

We present efficient and scalable parallel algorithms for performing mathematical operations for low-rank tensors represented in the tensor train (TT) format. We consider algorithms for addition, elementwise multiplication, computing norms…

Numerical Analysis · Mathematics 2021-09-08 Hussam Al Daas , Grey Ballard , Peter Benner

When conducting Bayesian inference, delayed acceptance (DA) Metropolis-Hastings (MH) algorithms and DA pseudo-marginal MH algorithms can be applied when it is computationally expensive to calculate the true posterior or an unbiased estimate…

Computation · Statistics 2016-06-02 Chris Sherlock , Andrew Golightly , Daniel A. Henderson

A new class of Markov chain Monte Carlo (MCMC) algorithms, based on simulating piecewise deterministic Markov processes (PDMPs), have recently shown great promise: they are non-reversible, can mix better than standard MCMC algorithms, and…

Computation · Statistics 2020-10-23 Augustin Chevallier , Paul Fearnhead , Matthew Sutton

Markov Chain Monte Carlo (MCMC) methods often take many iterations to converge for highly correlated or high-dimensional target density functions. Methods such as Hamiltonian Monte Carlo (HMC) or No-U-Turn Sampling (NUTS) use the…

Numerical Analysis · Mathematics 2024-08-08 Kislaya Ravi , Tobias Neckel , Hans-Joachim Bungartz

This paper introduces a Bayesian framework that combines Markov chain Monte Carlo (MCMC) sampling, dimensionality reduction, and neural density estimation to efficiently handle inverse problems that (i) must be solved multiple times, and…

Computational Engineering, Finance, and Science · Computer Science 2026-02-24 Giacomo Bottacini , Matteo Torzoni , Andrea Manzoni

In recent years, promising statistical modeling approaches to tensor data analysis have been rapidly developed. Traditional multivariate analysis tools, such as multivariate regression and discriminant analysis, are generalized from…

Methodology · Statistics 2023-06-22 Ning Wang , Xin Zhang , Qing Mai

Tensor train (TT) decomposition, a powerful tool for analyzing multidimensional data, exhibits superior performance in many machine learning tasks. However, existing methods for TT decomposition either suffer from noise overfitting, or…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Le Xu , Lei Cheng , Ngai Wong , Yik-Chung Wu

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

Tensor network contractions are widely used in statistical physics, quantum computing, and computer science. We introduce a method to efficiently approximate tensor network contractions using low-rank approximations, where each intermediate…

Quantum Physics · Physics 2025-01-01 Linjian Ma , Matthew Fishman , Miles Stoudenmire , Edgar Solomonik

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

We apply the Tensor Train (TT) approximation to construct the Polynomial Chaos Expansion (PCE) of a random field, and solve the stochastic elliptic diffusion PDE with the stochastic Galerkin discretization. We compare two strategies of the…

Numerical Analysis · Mathematics 2014-06-12 Sergey Dolgov , Boris N. Khoromskij , Alexander Litvinenko , Hermann G. Matthies

Thompson sampling for multi-armed bandit problems is known to enjoy favorable performance in both theory and practice. However, it suffers from a significant limitation computationally, arising from the need for samples from posterior…

Machine Learning · Computer Science 2020-06-19 Eric Mazumdar , Aldo Pacchiano , Yi-an Ma , Peter L. Bartlett , Michael I. Jordan

In intelligent transportation systems, traffic data imputation, estimating the missing value from partially observed data is an inevitable and challenging task. Previous studies have not fully considered traffic data's multidimensionality…

Machine Learning · Statistics 2023-11-01 Wenwu Gong , Zhejun Huang , Lili Yang

Traditional methods for unsupervised learning of finite mixture models require to evaluate the likelihood of all components of the mixture. This becomes computationally prohibitive when the number of components is large, as it is, for…

Machine Learning · Computer Science 2021-10-12 Milan Papež , Tomáš Pevný , Václav Šmídl