English
Related papers

Related papers: Quasi-Monte Carlo for Bayesian design of experimen…

200 papers

Many machine learning problems optimize an objective that must be measured with noise. The primary method is a first order stochastic gradient descent using one or more Monte Carlo (MC) samples at each step. There are settings where…

Machine Learning · Computer Science 2021-04-22 Sifan Liu , Art B. Owen

Bayesian inverse problems arise in various scientific and engineering domains, and solving them can be computationally demanding. This is especially the case for problems governed by partial differential equations, where the repeated…

Numerical Analysis · Mathematics 2025-11-04 Juntao Yang , Jeff Adie , Simon See , Adriano Gualandi , Gianmarco Mengaldo

Bayesian models have become very popular over the last years in several fields such as signal processing, statistics, and machine learning. Bayesian inference requires the approximation of complicated integrals involving posterior…

Computation · Statistics 2021-07-20 Luca Martino , Víctor Elvira

This paper investigates the formulation and implementation of Bayesian inverse problems to learn input parameters of partial differential equations (PDEs) defined on manifolds. Specifically, we study the inverse problem of determining the…

Numerical Analysis · Mathematics 2019-10-24 John Harlim , Daniel Sanz-Alonso , Ruiyi Yang

A new method based on nesting Monte Carlo is developed to solve high-dimensional semi-linear PDEs. Convergence of the method is proved and its convergence rate studied. Results in high dimension for different kind of non-linearities show…

Probability · Mathematics 2018-05-15 Xavier Warin

We develop a fast and scalable computational framework to solve large-scale and high-dimensional Bayesian optimal experimental design problems. In particular, we consider the problem of optimal observation sensor placement for Bayesian…

Numerical Analysis · Mathematics 2020-11-09 Keyi Wu , Peng Chen , Omar Ghattas

We consider the problem of improving the efficiency of randomized Fourier feature maps to accelerate training and testing speed of kernel methods on large datasets. These approximate feature maps arise as Monte Carlo approximations to…

Machine Learning · Statistics 2015-08-11 Haim Avron , Vikas Sindhwani , Jiyan Yang , Michael Mahoney

The theoretical development of quasi-Monte Carlo (QMC) methods for uncertainty quantification of partial differential equations (PDEs) is typically centered around simplified model problems such as elliptic PDEs subject to homogeneous zero…

Numerical Analysis · Mathematics 2025-03-26 Laura Bazahica , Vesa Kaarnioja , Lassi Roininen

In recent years, tremendous progress has been made on numerical algorithms for solving partial differential equations (PDEs) in a very high dimension, using ideas from either nonlinear (multilevel) Monte Carlo or deep learning. They are…

Numerical Analysis · Mathematics 2021-12-13 Weinan E , Jiequn Han , Arnulf Jentzen

Multilevel quadrature methods for parametric operator equations such as the multilevel (quasi-) Monte Carlo method are closely related to the sparse tensor product approximation between the spatial variable and the parameter. In this…

Numerical Analysis · Mathematics 2019-01-01 Michael Griebel , Helmut Harbrecht , Michael D. Multerer

We study the application of a quasi-Monte Carlo (QMC) method to a class of semi-linear parabolic reaction-diffusion partial differential equations used to model tumor growth. Mathematical models of tumor growth are largely phenomenological…

Numerical Analysis · Mathematics 2026-02-23 Alexander D. Gilbert , Frances Y. Kuo , Dirk Nuyens , Graham Pash , Ian H. Sloan , Karen E. Willcox

We propose a multilevel Markov chain Monte Carlo (MCMC) method for the Bayesian inference of random field parameters in PDEs using high-resolution data. Compared to existing multilevel MCMC methods, we additionally consider level-dependent…

Numerical Analysis · Mathematics 2025-08-19 Pieter Vanmechelen , Geert Lombaert , Giovanni Samaey

We study multivariate integration of functions that are invariant under the permutation (of a subset) of their arguments. Recently, in Nuyens, Suryanarayana, and Weimar (Adv. Comput. Math. (2016), 42(1):55--84), the authors derived an upper…

Numerical Analysis · Mathematics 2016-11-29 Dirk Nuyens , Gowri Suryanarayana , Markus Weimar

The Bayesian approach to Inverse Problems relies predominantly on Markov Chain Monte Carlo methods for posterior inference. The typical nonlinear concentration of posterior measure observed in many such Inverse Problems presents severe…

Computation · Statistics 2016-02-17 Shiwei Lan , Tan Bui-Thanh , Mike Christie , Mark Girolami

In high dimensional variable selection problems, statisticians often seek to design multiple testing procedures that control the False Discovery Rate (FDR), while concurrently identifying a greater number of relevant variables. Model-X…

Statistics Theory · Mathematics 2023-07-25 Taejoo Ahn , Licong Lin , Song Mei

In this note, we study a concatenation of quasi-Monte Carlo and plain Monte Carlo rules for high-dimensional numerical integration in weighted function spaces. In particular, we consider approximating the integral of periodic functions…

Numerical Analysis · Mathematics 2022-06-27 Takashi Goda

Bayesian statistical inverse problems are often solved with Markov chain Monte Carlo (MCMC)-type schemes. When the problems are governed by large-scale discrete nonlinear partial differential equations (PDEs), they are computationally…

Numerical Analysis · Mathematics 2019-09-06 Howard C. Elman , Akwum Onwunta

Bayesian optimal design is considered for experiments where the response distribution depends on the solution to a system of non-linear ordinary differential equations. The motivation is an experiment to estimate parameters in the equations…

Methodology · Statistics 2019-05-02 Antony Overstall , David Woods , Ben Parker

Quasi-Monte Carlo (QMC) methods for high dimensional integrals over unit cubes and products of spheres are well-studied in literature. We study QMC tractability of integrals of functions defined over the product of $m$ copies of the simplex…

Numerical Analysis · Mathematics 2015-04-29 Kinjal Basu

In many product development problems, the performance of the product is governed by two types of parameters called design parameter and environmental parameter. While the former is fully controllable, the latter varies depending on the…

Machine Learning · Statistics 2020-06-23 Shogo Iwazaki , Yu Inatsu , Ichiro Takeuchi