English
Related papers

Related papers: Likelihood Approximation With Hierarchical Matrice…

200 papers

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

We introduce a novel approach to portfolio optimization that leverages hierarchical graph structures and the Schur complement method to systematically reduce computational complexity while preserving full covariance information. Inspired by…

Portfolio Management · Quantitative Finance 2025-03-18 Gamal Mograby

We consider estimation of covariance matrices and their inverses (a.k.a. precision matrices) for high-dimensional stationary and locally stationary time series. In the latter case the covariance matrices evolve smoothly in time, thus…

Statistics Theory · Mathematics 2014-01-07 Xiaohui Chen , Mengyu Xu , Wei Biao Wu

We propose the K-series estimation approach for the recovery of unknown univariate and multivariate distributions given knowledge of a finite number of their moments. Our method is directly applicable to the probabilistic analysis of…

Methodology · Statistics 2025-04-15 Andrey Kofnov , Ezio Bartocci , Efstathia Bura

We study the problem of estimating the covariance matrix of a high-dimensional distribution when a small constant fraction of the samples can be arbitrarily corrupted. Recent work gave the first polynomial time algorithms for this problem…

Machine Learning · Computer Science 2019-06-12 Yu Cheng , Ilias Diakonikolas , Rong Ge , David Woodruff

In many astrophysical settings covariance matrices of large datasets have to be determined empirically from a finite number of mock realisations. The resulting noise degrades inference and precludes it completely if there are fewer…

Instrumentation and Methods for Astrophysics · Physics 2017-01-11 Benjamin Joachimi

Inference for high-dimensional hidden Markov models is challenging due to the exponential-in-dimension computational cost of calculating the likelihood. To address this issue, we introduce an innovative composite likelihood approach called…

Methodology · Statistics 2025-01-17 Lorenzo Rimella , Chris Jewell , Paul Fearnhead

This paper proposes a novel scheme for reduced-rank Gaussian process regression. The method is based on an approximate series expansion of the covariance function in terms of an eigenfunction expansion of the Laplace operator in a compact…

Machine Learning · Statistics 2020-06-26 Arno Solin , Simo Särkkä

Triangular factorizations are an important tool for solving integral equations and partial differential equations with hierarchical matrices ($\mathcal{H}$-matrices). Experiments show that using an $\mathcal{H}$-matrix LR factorization to…

Numerical Analysis · Mathematics 2019-05-28 Steffen Börm

We propose a fast stochastic Hamilton Monte Carlo (HMC) method, for sampling from a smooth and strongly log-concave distribution. At the core of our proposed method is a variance reduction technique inspired by the recent advance in…

Machine Learning · Statistics 2020-10-20 Difan Zou , Pan Xu , Quanquan Gu

Covariance functions are the core of spatial statistics, stochastic processes, machine learning as well as many other theoretical and applied disciplines. The properties of the covariance function at small and large distances determine the…

Statistics Theory · Mathematics 2023-01-16 Alfredo Alegría , Fabián Ramírez , Emilio Porcu

In Gaussian graphical models, the likelihood equations must typically be solved iteratively. We investigate two algorithms: A version of iterative proportional scaling which avoids inversion of large matrices, and an algorithm based on…

Computation · Statistics 2023-12-12 Søren Højsgaard , Steffen Lauritzen

The prevalence of spatially referenced multivariate data has impelled researchers to develop a procedure for the joint modeling of multiple spatial processes. This ordinarily involves modeling marginal and cross-process dependence for any…

Methodology · Statistics 2020-07-10 Ghulam A. Qadir , Ying Sun

In stochastic optimization problems using noisy zeroth-order (ZO) oracles only, the randomized counterpart of the Kiefer-Wolfowitz-type method is widely used to estimate the gradient. Existing algorithms generate randomized perturbation…

Optimization and Control · Mathematics 2020-11-30 Jingyi Zhu

In this paper, we propose a novel variable selection approach in the framework of multivariate linear models taking into account the dependence that may exist between the responses. It consists in estimating beforehand the covariance matrix…

Statistics Theory · Mathematics 2017-07-14 Marie Perrot-Dockès , Céline Lévy-Leduc , Laure Sansonnet , Julien Chiquet

This paper proposes a new robust smooth-threshold estimating equation to select important variables and automatically estimate parameters for high dimensional longitudinal data. A novel working correlation matrix is proposed to capture…

Methodology · Statistics 2021-11-30 Liya Fu , Jiaqi Li , You-Gan Wang

We propose a Kronecker product model for correlation or covariance matrices in the large dimensional case. The number of parameters of the model increases logarithmically with the dimension of the matrix. We propose a minimum distance (MD)…

Statistics Theory · Mathematics 2019-05-20 Christian M. Hafner , Oliver B. Linton , Haihan Tang

Due to the ease of modern data collection, applied statisticians often have access to a large set of covariates that they wish to relate to some observed outcome. Generalized linear models (GLMs) offer a particularly interpretable framework…

Computation · Statistics 2019-05-21 Brian L. Trippe , Jonathan H. Huggins , Raj Agrawal , Tamara Broderick

Spatial statistical modeling and prediction involve generating and manipulating an n*n symmetric positive definite covariance matrix, where n denotes the number of spatial locations. However, when n is large, processing this covariance…

Computation · Statistics 2024-02-15 Sihan Chen , Sameh Abdulah , Ying Sun , Marc G. Genton

We propose new methods for multivariate linear regression when the regression coefficient matrix is sparse and the error covariance matrix is dense. We assume that the error covariance matrix has equicorrelation across the response…

Methodology · Statistics 2025-08-13 Daeyoung Ham , Bradley S. Price , Adam J. Rothman