English
Related papers

Related papers: Scalable iterative methods for sampling from massi…

200 papers

The Gaussian random field (GRF) and the Gaussian Markov random field (GMRF) have been widely used to accommodate spatial dependence under the generalized linear mixed model framework. These models have limitations rooted in the symmetry and…

Methodology · Statistics 2022-12-15 Marcos O. Prates , Dipak K. Dey , Michael R. Willig , Jun Yan

In this paper, we propose a new estimation procedure for discovering the structure of Gaussian Markov random fields (MRFs) with false discovery rate (FDR) control, making use of the sorted l1-norm (SL1) regularization. A Gaussian MRF is an…

Machine Learning · Statistics 2019-10-25 Sangkyun Lee , Piotr Sobczyk , Malgorzata Bogdan

Atmospheric inverse modelling is a method for reconstructing historical fluxes of green-house gas between land and atmosphere, using observed atmospheric concentrations and an atmospheric tracer transport model. The small number of observed…

Applications · Statistics 2019-07-08 Unn Dahlen , Johan Linström , Marko Scholze

Statistical modeling of dependent directional data remains relatively underexplored, particularly in high-dimensional spatial settings. Existing approaches for spatial angular data primarily rely on wrapped Gaussian process (WGP) models,…

Methodology · Statistics 2026-03-09 Arnab Hazra

Gaussian processes are the gold standard for many real-world modeling problems, especially in cases where a model's success hinges upon its ability to faithfully represent predictive uncertainty. These problems typically exist as parts of…

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

Numerical Analysis · Mathematics 2026-03-24 Nicolas L. Guidotti , Per-Gunnar Martinsson , Juan A. Acebrón , José Monteiro

Gaussian processes are a powerful framework for uncertainty-aware function approximation and sequential decision-making. Unfortunately, their classical formulation does not scale gracefully to large amounts of data and modern hardware for…

Machine Learning · Computer Science 2025-07-10 Jihao Andreas Lin

This work introduces structure preserving hierarchical decompositions for sampling Gaussian random fields (GRF) within the context of multilevel Bayesian inference in high-dimensional space. Existing scalable hierarchical sampling methods,…

Numerical Analysis · Mathematics 2025-03-19 Sohail Reddy

Sampling from a lattice Gaussian distribution is emerging as an important problem in various areas such as coding and cryptography. The default sampling algorithm --- Klein's algorithm yields a distribution close to the lattice Gaussian…

Information Theory · Computer Science 2016-11-18 Zheng Wang , Cong Ling , Guillaume Hanrot

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

It is well-known that the posterior density of linear inverse problems with Gaussian prior and Gaussian likelihood is also Gaussian, hence completely described by its covariance and expectation. Sampling from a Gaussian posterior may be…

Numerical Analysis · Mathematics 2025-02-11 Daniela Calvetti , Erkki Somersalo

In this paper we consider the task of estimating the non-zero pattern of the sparse inverse covariance matrix of a zero-mean Gaussian random vector from a set of iid samples. Note that this is also equivalent to recovering the underlying…

Machine Learning · Computer Science 2012-02-28 Christopher C. Johnson , Ali Jalali , Pradeep Ravikumar

Generating large-scale samples of stationary random fields is of great importance in the fields such as geomaterial modeling and uncertainty quantification. Traditional methodologies based on covariance matrix decomposition have the…

Methodology · Statistics 2022-08-23 Bin Zhu , Jiahao Liu , Zhengshou Lai , Tao Qian

In order to sample from a given target distribution (often of Gibbs type), the Monte Carlo Markov chain method consists in constructing an ergodic Markov process whose invariant measure is the target distribution. By sampling the Markov…

Probability · Mathematics 2015-06-11 Luc Rey-Bellet , Kostantinos Spiliopoulos

Many probabilistic models introduce strong dependencies between variables using a latent multivariate Gaussian distribution or a Gaussian process. We present a new Markov chain Monte Carlo algorithm for performing inference in models with…

Computation · Statistics 2010-03-22 Iain Murray , Ryan Prescott Adams , David J. C. MacKay

Learning to sample from complex unnormalized distributions is a fundamental challenge in computational physics and machine learning. While score-based and variational methods have achieved success in continuous domains, extending them to…

Machine Learning · Statistics 2026-03-11 Lei Li , Zhen Wang , Lishuo Zhang

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

Machine Learning · Statistics 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

This paper presents a fast approach for penalized least squares (LS) regression problems using a 2D Gaussian Markov random field (GMRF) prior. More precisely, the computation of the proximity operator of the LS criterion regularized by…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Qi Wei , Emilie Chouzenoux , Jean-Yves Tourneret , Jean-Christophe Pesquet

The scalable calculation of matrix determinants has been a bottleneck to the widespread application of many machine learning methods such as determinantal point processes, Gaussian processes, generalised Markov random fields, graph models…

Numerical Analysis · Computer Science 2017-04-25 Jack Fitzsimons , Diego Granziol , Kurt Cutajar , Michael Osborne , Maurizio Filippone , Stephen Roberts