English
Related papers

Related papers: Preconditioning Markov Chain Monte Carlo Method fo…

200 papers

We show how to extend a recently proposed multi-level Monte Carlo approach to the continuous time Markov chain setting, thereby greatly lowering the computational complexity needed to compute expected values of functions of the state of the…

Probability · Mathematics 2011-11-23 David F. Anderson , Desmond J. Higham

Pre-conditioning is a well-known concept that can significantly improve the convergence of optimization algorithms. For noise-free problems, where good pre-conditioners are not known a priori, iterative linear algebra methods offer one way…

Machine Learning · Computer Science 2019-02-21 Filip de Roos , Philipp Hennig

We study the computational complexity of Markov chain Monte Carlo (MCMC) methods for high-dimensional Bayesian linear regression under sparsity constraints. We first show that a Bayesian approach can achieve variable-selection consistency…

Statistics Theory · Mathematics 2015-06-01 Yun Yang , Martin J. Wainwright , Michael I. Jordan

The mechanical behaviour of a poroelastic medium permeated by multiple interacting fluid networks can be described by a system of time-dependent partial differential equations known as the multiple-network poroelasticity (MPET) equations or…

Numerical Analysis · Mathematics 2020-10-20 Eleonora Piersanti , Jeonghun J. Lee , Travis Thompson , Kent-Andre Mardal , Marie E. Rognes

In this paper, we investigate and design multiscale simulations for stochastic multiscale PDEs. As for the space, we consider a coarse grid and a known multiscale method, the Generalized Multiscale Finite Element Method (GMsFEM). In order…

Numerical Analysis · Mathematics 2020-04-10 Zecheng Zhang , Eric Chung , Yalchin Efendiev , Wing Tat Leung

Multifidelity Monte Carlo methods often rely on a preprocessing phase consisting of standard Monte Carlo sampling to estimate correlation coefficients between models of different fidelity to determine the weights and number of samples for…

Data Analysis, Statistics and Probability · Physics 2021-06-29 Todd A. Oliver , Christopher S. Simmons , Robert D. Moser

We propose a novel $hp$-multilevel Monte Carlo method for the quantification of uncertainties in the compressible Navier-Stokes equations, using the Discontinuous Galerkin method as deterministic solver. The multilevel approach exploits…

Numerical Analysis · Mathematics 2020-08-25 A. Beck , J. Dürrwächter , T. Kuhn , F. Meyer , C. -D. Munz , C. Rohde

We present a novel technique for learning the mass matrices in samplers obtained from discretized dynamics that preserve some energy function. Existing adaptive samplers use Riemannian preconditioning techniques, where the mass matrices are…

Machine Learning · Computer Science 2017-11-08 Anirban Roychowdhury , Srinivasan Parthasarathy

In this article, we study the application of Multi-Level Monte Carlo (MLMC) approaches to numerical random homogenization. Our objective is to compute the expectation of some functionals of the homogenized coefficients, or of the…

Numerical Analysis · Mathematics 2013-01-15 Yalchin Efendiev , Cornelia Kronsbein , Frederic Legoll

In this article we develop a new sequential Monte Carlo (SMC) method for multilevel (ML) Monte Carlo estimation. In particular, the method can be used to estimate expectations with respect to a target probability distribution over an…

Computation · Statistics 2017-03-16 Alexandros Beskos , Ajay Jasra , Kody Law , Youssef Marzouk , Yan Zhou

This paper applies topology optimisation to the design of structures with periodic microstructural details without length scale separation, i.e. considering the complete macroscopic structure and its response, while resolving all…

Computational Engineering, Finance, and Science · Computer Science 2015-08-19 Joe Alexandersen , Boyan S. Lazarov

We propose a multilevel Monte Carlo-FEM algorithm to solve elliptic Bayesian inverse problems with "Besov random tree prior". These priors are given by a wavelet series with stochastic coefficients, and certain terms in the expansion…

Numerical Analysis · Mathematics 2023-02-03 Andreas Stein , Viet Ha Hoang

We consider regression problems where the number of predictors greatly exceeds the number of observations. We propose a method for variable selection that first estimates the regression function, yielding a "pre-conditioned" response…

Statistics Theory · Mathematics 2013-04-16 Debashis Paul , Eric Bair , Trevor Hastie , Robert Tibshirani

Single-site Markov Chain Monte Carlo (MCMC) is a variant of MCMC in which a single coordinate in the state space is modified in each step. Structured relational models are a good candidate for this style of inference. In the single-site…

We introduce a Monte Carlo Virtual Element estimator based on Virtual Element discretizations for stochastic elliptic partial differential equations with random diffusion coefficients. We prove estimates for the statistical approximation…

Numerical Analysis · Mathematics 2026-04-16 Paola F. Antonietti , Francesca Bonizzoni , Ilaria Perugia , Marco Verani

Stochastic gradient descent method and its variants constitute the core optimization algorithms that achieve good convergence rates for solving machine learning problems. These rates are obtained especially when these algorithms are…

Machine Learning · Computer Science 2024-03-14 S. Ilker Birbil , Ozgur Martin , Gonenc Onay , Figen Oztoprak

In this paper, we consider an efficient iterative approach to the solution of the discrete Helmholtz equation with Dirichlet, Neumann and Sommerfeld-like boundary conditions based on a compact sixth order approximation scheme and…

Numerical Analysis · Mathematics 2012-12-07 Yury Gryazin

We study nonlinearly preconditioned gradient methods for smooth nonconvex optimization problems, focusing on sigmoid preconditioners that inherently perform a form of gradient clipping akin to the widely used gradient clipping technique.…

Optimization and Control · Mathematics 2025-10-14 Konstantinos Oikonomidis , Jan Quan , Panagiotis Patrinos

A thresholded Gaussian random field model is developed for the microstructure of porous materials. Defining the random field as a solution to stochastic partial differential equation allows for flexible modelling of non-stationarities in…

Applications · Statistics 2017-08-22 Sandra Barman , David Bolin

In this paper we study fast iterative solvers for the large sparse linear systems resulting from the stochastic Galerkin discretization of stochastic partial differential equations. A block triangular preconditioner is introduced and…

Numerical Analysis · Mathematics 2013-04-08 Bin Zheng , Guang Lin , Jinchao Xu