中文
相关论文

相关论文: Sparsity-based Cholesky Factorization and its Appl…

200 篇论文

Estimating a sparse covariance matrix is a fundamental problem in high-dimensional statistics. However, thresholding methods developed for independent data are generally not directly applicable to high-dimensional time series, where…

统计方法学 · 统计学 2026-05-15 Wenhao Zhang , Zhaoxing Gao

This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be…

信息论 · 计算机科学 2016-07-29 Fei Wen , Yuan Yang , Peilin Liu , Robert C. Qiu

This paper aims at achieving a simultaneously sparse and low-rank estimator from the semidefinite population covariance matrices. We first benefit from a convex optimization which develops $l_1$-norm penalty to encourage the sparsity and…

统计理论 · 数学 2014-08-08 Shenglong Zhou , Naihua Xiu , Ziyan Luo , Lingchen Kong

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

统计方法学 · 统计学 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

Covariance estimation becomes challenging in the regime where the number p of variables outstrips the number n of samples available to construct the estimate. One way to circumvent this problem is to assume that the covariance matrix is…

概率论 · 数学 2012-06-14 Richard Y. Chen , Alex Gittens , Joel A. Tropp

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

统计理论 · 数学 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

Covariance selection seeks to estimate a covariance matrix by maximum likelihood while restricting the number of nonzero inverse covariance matrix coefficients. A single penalty parameter usually controls the tradeoff between log likelihood…

最优化与控制 · 数学 2010-10-12 Vijay Krishnamurthy , Alexandre d'Aspremont

We provide more technical details about the HLIBCov package, which is using parallel hierarchical ($\H$-) matrices to identify unknown parameters of the covariance function (variance, smoothness, and covariance length). These parameters are…

统计计算 · 统计学 2019-05-02 Alexander Litvinenko

Sparse estimation methods are aimed at using or obtaining parsimonious representations of data or models. They were first dedicated to linear variable selection but numerous extensions have now emerged such as structured sparsity or kernel…

机器学习 · 计算机科学 2011-11-24 Francis Bach , Rodolphe Jenatton , Julien Mairal , Guillaume Obozinski

This paper addresses matrix approximation problems for matrices that are large, sparse and/or that are representations of large graphs. To tackle these problems, we consider algorithms that are based primarily on coarsening techniques,…

数值分析 · 计算机科学 2018-10-03 Shashanka Ubaru , Yousef Saad

We study the estimation of the covariance matrix $\Sigma$ of a $p$-dimensional normal random vector based on $n$ independent observations corrupted by additive noise. Only a general nonparametric assumption is imposed on the distribution of…

统计理论 · 数学 2018-03-28 Denis Belomestny , Mathias Trabs , Alexandre B. Tsybakov

In this paper, we review state-of-the-art methods for feature selection in statistics with an application-oriented eye. Indeed, sparsity is a valuable property and the profusion of research on the topic might have provided little guidance…

统计方法学 · 统计学 2021-11-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

The interest in variable selection for clustering has increased recently due to the growing need in clustering high-dimensional data. Variable selection allows in particular to ease both the clustering and the interpretation of the results.…

统计方法学 · 统计学 2012-04-11 Charles Bouveyron , Camille Brunet

This paper presents a new method for estimating high dimensional covariance matrices. The method, permuted rank-penalized least-squares (PRLS), is based on a Kronecker product series expansion of the true covariance matrix. Assuming an…

统计方法学 · 统计学 2013-12-25 Theodoros Tsiligkaridis , Alfred O. Hero

In this paper, the high-dimensional sparse linear regression model is considered, where the overall number of variables is larger than the number of observations. We investigate the L1 penalized least absolute deviation method. Different…

统计方法学 · 统计学 2012-02-29 Lie Wang

In this paper, we study the problem of high-dimensional approximately low-rank covariance matrix estimation with missing observations. We propose a simple procedure computationally tractable in high-dimension and that does not require…

统计理论 · 数学 2012-05-14 Karim Lounici

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

机器学习 · 统计学 2012-06-22 Tingni Sun , Cun-Hui Zhang

We examine a special case of the multilevel factor model, with covariance given by multilevel low rank (MLR) matrix~\cite{parshakova2023factor}. We develop a novel, fast implementation of the expectation-maximization algorithm, tailored for…

机器学习 · 统计学 2025-08-26 Tetiana Parshakova , Trevor Hastie , Stephen Boyd

We consider the joint estimation of change point locations and the sparsity pattern of the variance covariance matrix, which is assumed to evolve in a piecewise constant manner. By applying Group Fused LASSO and LASSO penalties to the…

统计方法学 · 统计学 2026-05-14 Ying Lin , Benjamin Poignard

Natural gradients can improve convergence in stochastic variational inference significantly but inverting the Fisher information matrix is daunting in high dimensions. Moreover, in Gaussian variational approximation, natural gradient…

统计计算 · 统计学 2025-02-05 Linda S. L. Tan