中文
相关论文

相关论文: A Computational Note on the Graphical Ridge in Hig…

200 篇论文

Large-scale generalized linear array models (GLAMs) can be challenging to fit. Computation and storage of its tensor product design matrix can be impossible due to time and memory constraints, and previously considered design matrix free…

统计计算 · 统计学 2016-09-05 Adam Lund , Martin Vincent , Niels Richard Hansen

This paper studies the partial estimation of Gaussian graphical models from high-dimensional empirical observations. We derive a convex formulation for this problem using $\ell_1$-regularized maximum-likelihood estimation, which can be…

机器学习 · 计算机科学 2012-10-01 Xiao-Tong Yuan , Tong Zhang

While shrinkage is essential in high-dimensional settings, its use for low-dimensional regression-based prediction has been debated. It reduces variance, often leading to improved prediction accuracy. However, it also inevitably introduces…

We propose estimating Gaussian graphical models (GGMs) that are fair with respect to sensitive nodal attributes. Many real-world models exhibit unfair discriminatory behavior due to biases in data. Such discrimination is known to be…

机器学习 · 统计学 2024-06-17 Madeline Navarro , Samuel Rey , Andrei Buciulea , Antonio G. Marques , Santiago Segarra

This article is concerned with the Bridge Regression, which is a special family in penalized regression with penalty function $\sum_{j=1}^{p}|\beta_j|^q$ with $q>0$, in a linear model with linear restrictions. The proposed restricted bridge…

统计理论 · 数学 2021-05-06 Bahadır Yüzbaşı , Mohammad Arashi , Fikri Akdeniz

We consider a graphical model where a multivariate normal vector is associated with each node of the underlying graph and estimate the graphical structure. We minimize a loss function obtained by regressing the vector at each node on those…

机器学习 · 统计学 2017-09-19 Xingqi Du , Subhashis Ghosal

For high-dimensional linear regression models, we review and compare several estimators of variances $\tau^2$ and $\sigma^2$ of the random slopes and errors, respectively. These variances relate directly to ridge regression penalty…

统计计算 · 统计学 2019-02-08 Jurre R. Veerman , Gwenael G. R. Leday , Mark A. van de Wiel

We apply a method recently introduced to the statistical literature to directly estimate the precision matrix from an ensemble of samples drawn from a corresponding Gaussian distribution. Motivated by the observation that cosmological…

天体物理仪器与方法 · 物理学 2016-05-25 Nikhil Padmanabhan , Martin White , Harrison H. Zhou , Ross O'Connell

This paper investigates the two-step estimation of a high dimensional additive regression model, in which the number of nonparametric additive components is potentially larger than the sample size but the number of significant additive…

统计理论 · 数学 2013-01-30 Kengo Kato

Estimating high-dimensional precision matrices is a fundamental problem in modern statistics, with the graphical lasso and its $\ell_1$-penalty being a standard approach for recovering sparsity patterns. However, many statistical models,…

统计理论 · 数学 2025-06-19 Piotr Graczyk , Bartosz Kołodziejek , Hideto Nakashima , Maciej Wilczyński

High-dimensional penalized rank regression is a powerful tool for modeling high-dimensional data due to its robustness and estimation efficiency. However, the non-smoothness of the rank loss brings great challenges to the computation. To…

统计方法学 · 统计学 2025-02-20 Leheng Cai , Xu Guo , Heng Lian , Liping Zhu

Finite Gaussian mixture models provide a powerful and widely employed probabilistic approach for clustering multivariate continuous data. However, the practical usefulness of these models is jeopardized in high-dimensional spaces, where…

统计方法学 · 统计学 2022-05-13 Alessandro Casa , Andrea Cappozzo , Michael Fop

Common regularization algorithms for linear regression, such as LASSO and Ridge regression, rely on a regularization hyperparameter that balances the tradeoff between minimizing the fitting error and the norm of the learned model…

机器学习 · 计算机科学 2023-11-27 Gabriele Maroni , Loris Cannelli , Dario Piga

We consider Bayesian estimation of a $p\times p$ precision matrix, when $p$ can be much larger than the available sample size $n$. It is well known that consistent estimation in such ultra-high dimensional situations requires regularization…

统计理论 · 数学 2014-11-07 Sayantan Banerjee , Subhashis Ghosal

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

最优化与控制 · 数学 2023-03-23 Matteo Lapucci , Christian Kanzow

The `Signal plus Noise' model for nonparametric regression can be extended to the case of observations taken at the vertices of a graph. This model includes many familiar regression problems. This article discusses the use of the edges of a…

统计方法学 · 统计学 2009-11-11 Arne Kovac , Andrew D. A. C. Smith

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

统计方法学 · 统计学 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

Neighborhood selection is a widely used method used for estimating the support set of sparse precision matrices, which helps determine the conditional dependence structure in undirected graphical models. However, reporting only point…

统计方法学 · 统计学 2023-12-29 Yiling Huang , Snigdha Panigrahi , Walter Dempsey

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

机器学习 · 统计学 2011-06-28 Suvrit Sra , Dongmin Kim

There has been an intense development of Bayes graphical model estimation approaches over the past decade - however, most of the existing methods are restricted to moderate dimensions. We propose a novel approach suitable for high…

统计方法学 · 统计学 2013-08-20 Suprateek Kundu , Veera Baladandayuthapani , Bani K. Mallick