English
Related papers

Related papers: Weighted Average Ensemble for Cholesky-based Covar…

200 papers

Finite mixtures of regressions with fixed covariates are a commonly used model-based clustering methodology to deal with regression data. However, they assume assignment independence, i.e. the allocation of data points to the clusters is…

Methodology · Statistics 2021-04-27 Salvatore D. Tomarchio , Paul D. McNicholas , Antonio Punzo

We introduce a Monte Carlo Virtual Element estimator based on Virtual Element discretizations for stochastic elliptic partial differential equations with random diffusion coefficients. We prove estimates for the statistical approximation…

Numerical Analysis · Mathematics 2026-04-16 Paola F. Antonietti , Francesca Bonizzoni , Ilaria Perugia , Marco Verani

Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings…

Methodology · Statistics 2022-06-06 Huiqin Xin , Sihai Dave Zhao

We study weighted ensemble, an interacting particle method for sampling distributions of Markov chains that has been used in computational chemistry since the 1990s. Many important applications of weighted ensemble require the computation…

Numerical Analysis · Mathematics 2022-04-22 David Aristoff

In machine learning, ensembles are important tools for improving the model performance. In natural language processing specifically, ensembles boost the performance of a method due to multiple large models available in open source. However,…

Machine Learning · Computer Science 2025-01-30 Polina Proskura , Alexey Zaytsev

This paper proposes a novel method to estimate large panel data error-correction models with stationary/non-stationary covariates and spatially dependent errors, which allows for known/unknown group-specific patterns of slope heterogeneity.…

Applications · Statistics 2017-09-12 Ba Chu

Classifying structural variability in noisy projections of biological macromolecules is a central problem in Cryo-EM. In this work, we build on a previous method for estimating the covariance matrix of the three-dimensional structure…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Joakim Andén , Eugene Katsevich , Amit Singer

Bayesian inference for factorial hidden Markov models is challenging due to the exponentially sized latent variable space. Standard Monte Carlo samplers can have difficulties effectively exploring the posterior landscape and are often…

Computation · Statistics 2019-02-28 Kaspar Märtens , Michalis K Titsias , Christopher Yau

The doubly robust estimator, which models both the propensity score and outcomes, is a popular approach to estimate the average treatment effect in the potential outcome setting. The primary appeal of this estimator is its theoretical…

Methodology · Statistics 2024-09-11 Kaoru Babasaki , Shonosuke Sugasawa , Kosaku Takanashi , Kenichiro McAlinn

Generalized linear mixed models (GLMMs) are a widely used tool in statistical analysis. The main bottleneck of many computational approaches lies in the inversion of the high dimensional precision matrices associated with the random…

Computation · Statistics 2025-10-08 Andrea Pandolfi , Omiros Papaspiliopoulos , Giacomo Zanella

Instance segmentation has witnessed promising advancements through deep neural network-based algorithms. However, these models often exhibit incorrect predictions with unwarranted confidence levels. Consequently, evaluating prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Qasim M. K. Siddiqui , Sebastian Starke , Peter Steinbach

Markov chain Monte Carlo methods are a powerful and commonly used family of numerical methods for sampling from complex probability distributions. As applications of these methods increase in size and complexity, the need for efficient…

Numerical Analysis · Mathematics 2019-01-31 Colin Cotter , Simon Cotter , Paul Russell

We propose a new pivotal method for estimating high-dimensional matrices. Assume that we observe a small set of entries or linear combinations of entries of an unknown matrix $A\_0$ corrupted by noise. We propose a new method for estimating…

Statistics Theory · Mathematics 2015-02-03 Olga Klopp , Stéphane Gaiffas

Practitioners of Bayesian statistics have long depended on Markov chain Monte Carlo (MCMC) to obtain samples from intractable posterior distributions. Unfortunately, MCMC algorithms are typically serial, and do not scale to the large…

Machine Learning · Statistics 2015-06-11 Maxim Rabinovich , Elaine Angelino , Michael I. Jordan

The dynamic mode decomposition (DMD) has become a leading tool for data-driven modeling of dynamical systems, providing a regression framework for fitting linear dynamical models to time-series measurement data. We present a simple…

Numerical Analysis · Mathematics 2017-04-11 Travis Askham , J. Nathan Kutz

Distance weighted discrimination (DWD) is a linear discrimination method that is particularly well-suited for classification tasks with high-dimensional data. The DWD coefficients minimize an intuitive objective function, which can solved…

Methodology · Statistics 2020-10-08 Eric F. Lock

Support vector machine (SVM) is a well-known statistical technique for classification problems in machine learning and other fields. An important question for SVM is the selection of covariates (or features) for the model. Many studies have…

Methodology · Statistics 2022-02-22 Jiahui Zou , Chaoxia Yuan , Xinyu Zhang , Guohua Zou , Alan T. K. Wan

We present novel Monte Carlo (MC) and multilevel Monte Carlo (MLMC) methods to determine the unbiased covariance of random variables using h-statistics. The advantage of this procedure lies in the unbiased construction of the estimator's…

Statistics Theory · Mathematics 2024-05-09 Sharana Kumar Shivanand

Generalized cross-validation (GCV) is a widely-used method for estimating the squared out-of-sample prediction risk that employs a scalar degrees of freedom adjustment (in a multiplicative sense) to the squared training error. In this…

Statistics Theory · Mathematics 2024-04-23 Pierre C. Bellec , Jin-Hong Du , Takuya Koriyama , Pratik Patil , Kai Tan

We consider the joint estimation of change point locations and the sparsity pattern of the variance covariance matrix, which is assumed to evolve in a piecewise constant manner. By applying Group Fused LASSO and LASSO penalties to the…

Methodology · Statistics 2026-05-14 Ying Lin , Benjamin Poignard