English
Related papers

Related papers: Data sparse multilevel covariance estimation in op…

200 papers

The efficient simulation of the mean value of a non-linear functional of the solution to a linear stochastic partial differential equation (SPDE) with additive Gaussian noise is considered. A Galerkin finite element method is employed along…

Probability · Mathematics 2019-07-25 Andreas Petersson

Smoothing of noisy sample covariances is an important component in functional data analysis. We propose a novel covariance smoothing method based on penalized splines and associated software. The proposed method is a bivariate spline…

Methodology · Statistics 2017-04-07 Luo Xiao , Cai Li , William Checkley , Ciprian M. Crainiceanu

Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the…

Computation · Statistics 2019-04-29 Lingge Li , Andrew Holbrook , Babak Shahbaba , Pierre Baldi

Covariance function estimation is a fundamental task in multivariate functional data analysis and arises in many applications. In this paper, we consider estimating sparse covariance functions for high-dimensional functional data, where the…

Statistics Theory · Mathematics 2022-07-15 Qin Fang , Shaojun Guo , Xinghao Qiao

We develop a theoretical framework for studying numerical estimation of lower previsions, generally applicable to two-level Monte Carlo methods, importance sampling methods, and a wide range of other sampling methods one might devise. We…

Computation · Statistics 2018-07-12 Matthias C. M. Troffaes

In this paper, we consider the problem of estimating the covariance kernel and its eigenvalues and eigenfunctions from sparse, irregularly observed, noise corrupted and (possibly) correlated functional data. We present a method based on…

Methodology · Statistics 2008-07-09 Debashis Paul , Jie Peng

In this article, we study the application of Multi-Level Monte Carlo (MLMC) approaches to numerical random homogenization. Our objective is to compute the expectation of some functionals of the homogenized coefficients, or of the…

Numerical Analysis · Mathematics 2013-01-15 Yalchin Efendiev , Cornelia Kronsbein , Frederic Legoll

We propose novel scale-invariant error estimators for the Monte Carlo and multilevel Monte Carlo estimation of mean and variance. For any linear transformation of the distribution of the quantity of interest, the computation cost across…

Numerical Analysis · Mathematics 2025-12-09 Sharana Kumar Shivanand , Bojana Rosić

When the target parameter for inference is a real-valued, continuous function of probabilities in the $k$-sample multinomial problem, variance estimation may be challenging. In small samples or when the function is nondifferentiable at the…

Computation · Statistics 2025-05-13 Michael C Sachs , Erin E Gabriel , Michael P Fay

We present a new Subset Simulation approach using Hamiltonian neural network-based Monte Carlo sampling for reliability analysis. The proposed strategy combines the superior sampling of the Hamiltonian Monte Carlo method with…

Machine Learning · Statistics 2024-01-11 Denny Thaler , Somayajulu L. N. Dhulipala , Franz Bamer , Bernd Markert , Michael D. Shields

We present a Monte Carlo method to compute efficiently susceptibilites or covariances of two physical variables. The method relies on a generalization of the exchange cluster algorithm to any model of interacting particles with any $2$-body…

Computational Physics · Physics 2025-02-11 Assaraf Roland , Chevreau Hilaire

Monte Carlo is a simple and flexible tool that is widely used in computational finance. In this context, it is common for the quantity of interest to be the expected value of a random variable defined via a stochastic differential equation.…

Numerical Analysis · Mathematics 2015-05-06 Desmond J. Higham

In high-dimensional data analysis, bi-level sparsity is often assumed when covariates function group-wisely and sparsity can appear either at the group level or within certain groups. In such cases, an ideal model should be able to…

Methodology · Statistics 2021-09-14 Bin Luo , Xiaoli Gao

In this paper, we study a smoothness regularization method for a varying coefficient model based on sparse and irregularly sampled functional data which is contaminated with some measurement errors. We estimate the one-dimensional…

Methodology · Statistics 2017-11-28 Behdad Mostafaiy

We study the sample complexity of estimating the covariance matrix $T$ of a distribution $\mathcal{D}$ over $d$-dimensional vectors, under the assumption that $T$ is Toeplitz. This assumption arises in many signal processing problems, where…

Signal Processing · Electrical Eng. & Systems 2019-10-31 Yonina C. Eldar , Jerry Li , Cameron Musco , Christopher Musco

This paper considers the challenging computational task of estimating nested expectations. Existing algorithms, such as nested Monte Carlo or multilevel Monte Carlo, are known to be consistent but require a large number of samples at both…

Machine Learning · Statistics 2025-06-05 Zonghao Chen , Masha Naslidnyk , François-Xavier Briol

Monte Carlo integration becomes prohibitively expensive when each sample requires a high-fidelity model evaluation. Multi-fidelity uncertainty quantification methods mitigate this by combining estimators from high- and low-fidelity models,…

Methodology · Statistics 2025-08-27 Thomas E. Coons , Aniket Jivani , Xun Huan

This work introduces a novel multilevel Monte Carlo (MLMC) metamodeling approach for variance function estimation. Although devising an efficient experimental design for simulation metamodeling can be elusive, the MLMC-based approach…

Methodology · Statistics 2025-04-22 Jingtao Zhang , Xi Chen

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A…

Machine Learning · Statistics 2019-01-16 Martin Azizyan , Akshay Krishnamurthy , Aarti Singh

Multidimensional function data arise from many fields nowadays. The covariance function plays an important role in the analysis of such increasingly common data. In this paper, we propose a novel nonparametric covariance function estimation…

Methodology · Statistics 2021-09-14 Jiayi Wang , Raymond K. W. Wong , Xiaoke Zhang