English
Related papers

Related papers: Data sparse multilevel covariance estimation in op…

200 papers

In this article we develop a new sequential Monte Carlo (SMC) method for multilevel (ML) Monte Carlo estimation. In particular, the method can be used to estimate expectations with respect to a target probability distribution over an…

Computation · Statistics 2017-03-16 Alexandros Beskos , Ajay Jasra , Kody Law , Youssef Marzouk , Yan Zhou

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

We develop a multi-level restricted Gaussian maximum likelihood method for estimating the covariance function parameters and computing the best unbiased predictor. Our approach produces a new set of multi-level contrasts where the…

Computation · Statistics 2016-03-29 Julio E. Castrillon-Candas , Marc G. Genton , Rio Yokota

We consider the application of multilevel Monte Carlo methods to elliptic PDEs with random coefficients. We focus on models of the random coefficient that lack uniform ellipticity and boundedness with respect to the random parameter, and…

Numerical Analysis · Mathematics 2012-04-17 A. L. Teckentrup , R. Scheichl , M. B. Giles , E. Ullmann

The multilevel Monte Carlo method is applied to an academic example in the field of electromagnetism. The method exhibits a reduced variance by assigning the samples to multiple models with a varying spatial resolution. For the given…

Computational Engineering, Finance, and Science · Computer Science 2017-09-26 Armin Galetzka , Zeger Bontinck , Ulrich Römer , Sebastian Schöps

We consider the class of convex minimization problems, composed of a self-concordant function, such as the $\log\det$ metric, a convex data fidelity term $h(\cdot)$ and, a regularizing -- possibly non-smooth -- function $g(\cdot)$. This…

Machine Learning · Statistics 2014-05-14 Anastasios Kyrillidis , Rabeeh Karimi Mahabadi , Quoc Tran-Dinh , Volkan Cevher

Sparse covariance matrices play crucial roles by encoding the interdependencies between variables in numerous fields such as genetics and neuroscience. Despite substantial studies on sparse covariance matrices, existing methods face several…

Methodology · Statistics 2026-03-03 Rakheon Kim , Irina Gaynanova

Partial differential equation is a powerful tool to characterize various physics systems. In practice, measurement errors are often present and probability models are employed to account for such uncertainties. In this paper, we present a…

Probability · Mathematics 2016-05-23 Xiaoou Li , Jingchen Liu

Computing risk measures of a financial portfolio comprising thousands of derivatives is a challenging problem because (a) it involves a nested expectation requiring multiple evaluations of the loss of the financial portfolio for different…

Mathematical Finance · Quantitative Finance 2023-01-10 Michael B. Giles , Abdul-Lateef Haji-Ali

Centered Gaussian random fields (GRFs) indexed by compacta such as smooth, bounded Euclidean domains or smooth, compact and orientable manifolds are determined by their covariance operators. We consider centered GRFs given as variational…

Statistics Theory · Mathematics 2021-03-09 Helmut Harbrecht , Lukas Herrmann , Kristin Kirchner , Christoph Schwab

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

Machine Learning · Statistics 2016-06-03 Jinghui Chen , Quanquan Gu

A compression algorithm is introduced for multi-determinant wave functions which can greatly reduce the number of determinants that need to be evaluated in quantum Monte Carlo calculations. We have devised an algorithm with three levels of…

Computational Physics · Physics 2015-06-17 Gihan L. Weerasinghe , Pablo Lopez Rios , Richard J. Needs

This paper considers covariance matrix estimation of tensor data under high dimensionality. A multi-bandable covariance class is established to accommodate the need for complex covariance structures of multi-layer lattices and general…

Methodology · Statistics 2026-01-13 Hao-Xuan Sun , Song Xi Chen , Yumou Qiu

Many popular statistical models, such as factor and random effects models, give arise a certain type of covariance structures that is a summation of low rank and sparse matrices. This paper introduces a penalized approximation framework to…

Methodology · Statistics 2015-03-19 Xi Luo

Multifidelity Monte Carlo methods often rely on a preprocessing phase consisting of standard Monte Carlo sampling to estimate correlation coefficients between models of different fidelity to determine the weights and number of samples for…

Data Analysis, Statistics and Probability · Physics 2021-06-29 Todd A. Oliver , Christopher S. Simmons , Robert D. Moser

We discuss the application of multilevel Monte Carlo methods to elliptic partial differential equations with random coefficients. Such problems arise, for example, in uncertainty quantification in subsurface flow modeling. We give a brief…

Numerical Analysis · Mathematics 2012-06-08 A. L. Teckentrup

With origins in game theory, probabilistic values like Shapley values, Banzhaf values, and semi-values have emerged as a central tool in explainable AI. They are used for feature attribution, data attribution, data valuation, and more.…

Machine Learning · Computer Science 2026-01-14 R. Teal Witter , Yurong Liu , Christopher Musco

When dealing with difficult inverse problems such as inverse rendering, using Monte Carlo estimated gradients to optimise parameters can slow down convergence due to variance. Averaging many gradient samples in each iteration reduces this…

Graphics · Computer Science 2023-09-28 Martin Balint , Karol Myszkowski , Hans-Peter Seidel , Gurprit Singh

Markov chain Monte Carlo (MCMC) algorithms are used to estimate features of interest of a distribution. The Monte Carlo error in estimation has an asymptotic normal distribution whose multivariate nature has so far been ignored in the MCMC…

Statistics Theory · Mathematics 2016-07-05 Dootika Vats , James M. Flegal , Galin L. Jones

This paper is concerned with optimizing the global minimum-variance portfolio's (GMVP) weights in high-dimensional settings where both observation and population dimensions grow at a bounded ratio. Optimizing the GMVP weights is highly…

Signal Processing · Electrical Eng. & Systems 2022-04-13 Maaz Mahadi , Tarig Ballal , Muhammad Moinuddin , Tareq Y. Al-Naffouri , Ubaid Al-Saggaf