English
Related papers

Related papers: Primary-Space Adaptive Control Variates using Piec…

200 papers

This paper focuses on signal processing tasks in which the signal is transformed from the signal space to a higher dimensional coefficient space (also called phase space) using a continuous frame, processed in the coefficient space, and…

Numerical Analysis · Mathematics 2021-09-14 Ron Levie , Haim Avron

The Multilevel Monte Carlo method is an efficient variance reduction technique. It uses a sequence of coarse approximations to reduce the computational cost in uncertainty quantification applications. The method is nowadays often considered…

Numerical Analysis · Mathematics 2018-06-15 Pieterjan Robbe , Dirk Nuyens , Stefan Vandewalle

Importance sampling is one of the most widely used variance reduction strategies in Monte Carlo rendering. In this paper, we propose a novel importance sampling technique that uses a neural network to learn how to sample from a desired…

Machine Learning · Computer Science 2024-03-25 Quan Zheng , Matthias Zwicker

Neural Networks have been widely used to solve Partial Differential Equations. These methods require to approximate definite integrals using quadrature rules. Here, we illustrate via 1D numerical examples the quadrature problems that may…

Numerical Analysis · Mathematics 2022-03-09 Jon A. Rivera , Jamie M. Taylor , Ángel J. Omella , David Pardo

Path integral (PI) control problems are a restricted class of non-linear control problems that can be solved formally as a Feyman-Kac path integral and can be estimated using Monte Carlo sampling. In this contribution we review path…

Systems and Control · Computer Science 2016-03-23 Hilbert Johan Kappen , Hans Christian Ruiz

Flexible variational distributions improve variational inference but are harder to optimize. In this work we present a control variate that is applicable for any reparameterizable distribution with known mean and covariance matrix, e.g.…

Machine Learning · Computer Science 2020-10-26 Tomas Geffner , Justin Domke

We introduce a new strategy for coupling the parallel in time (parareal) iterative methodology with multiscale integrators. Following the parareal framework, the algorithm computes a low-cost approximation of all slow variables in the…

Numerical Analysis · Mathematics 2015-11-19 Gil Ariel , Seong Jun Kim , Richard Tsai

We consider the problem of adaptive stratified sampling for Monte Carlo integration of a differentiable function given a finite number of evaluations to the function. We construct a sampling scheme that samples more often in regions where…

Machine Learning · Statistics 2012-10-22 Alexandra Carpentier , Rémi Munos

Estimating high-quality images while also quantifying their uncertainty are two desired features in an image reconstruction algorithm for solving ill-posed inverse problems. In this paper, we propose plug-and-play Monte Carlo (PMC) as a…

Image and Video Processing · Electrical Eng. & Systems 2024-08-29 Yu Sun , Zihui Wu , Yifan Chen , Berthy T. Feng , Katherine L. Bouman

Space filling designs are central to studying complex systems in various areas of science. They are used for obtaining an overall understanding of the behaviour of the response over the input space, model construction and uncertainty…

Methodology · Statistics 2016-08-10 Shirin Golchi , Jason L. Loeppky

In this work we detail the application of a fast convolution algorithm computing high dimensional integrals to the context of multiplicative noise stochastic processes. The algorithm provides a numerical solution to the problem of…

Computational Finance · Quantitative Finance 2015-03-19 Giacomo Bormetti , Sofia Cazzaniga

We present a general sample reweighting scheme and its underlying theory for the integration of an unknown function with low dimensionality. Our method produces better results than standard weighting schemes for common sampling strategies,…

Graphics · Computer Science 2019-08-07 Jerry Jinfeng Guo , Elmar Eisemann

Using neural networks to solve variational problems, and other scientific machine learning tasks, has been limited by a lack of consistency and an inability to exactly integrate expressions involving neural network architectures. We address…

Machine Learning · Computer Science 2021-10-28 Jonas A. Actor , Andy Huang , Nathaniel Trask

We study the feature-scaled version of the Monte Carlo algorithm with linear function approximation. This algorithm converges to a scale-invariant solution, which is not unduly affected by states having feature vectors with large norms. The…

Machine Learning · Computer Science 2022-05-31 Rahul Madhavan , Hemanta Makwana

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

In this work, a Bayesian approximate message passing algorithm is proposed for solving the multiple measurement vector (MMV) problem in compressive sensing, in which a collection of sparse signal vectors that share a common support are…

Information Theory · Computer Science 2013-01-29 Justin Ziniel , Philip Schniter

The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior…

Computation · Statistics 2018-05-11 Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

We consider high-dimensional measurement errors with high-frequency data. Our objective is on recovering the high-dimensional cross-sectional covariance matrix of the random errors with optimality. In this problem, not all components of the…

Statistics Theory · Mathematics 2024-04-03 Jinyuan Chang , Qiao Hu , Cheng Liu , Cheng Yong Tang

We present a technique that enables the evaluation of perturbative expansions based on one-loop-renormalized vertices up to large expansion orders. Specifically, we show how to compute large-order corrections to the random phase…

Strongly Correlated Electrons · Physics 2020-11-19 Fedor Šimkovic , Riccardo Rossi , Michel Ferrero

Control variates are variance reduction techniques for Monte Carlo estimators. They play a critical role in improving Monte Carlo estimators in scientific and machine learning applications that involve computationally expensive integrals.…

Methodology · Statistics 2026-02-27 Kaiyu Li , Yiming Yang , Xiaoyuan Cheng , Yi He , Zhuo Sun