English
Related papers

Related papers: Asymptotic Theory for Graphical SLOPE: Precision E…

200 papers

Nonconvex penalty methods for sparse modeling in linear regression have been a topic of fervent interest in recent years. Herein, we study a family of nonconvex penalty functions that we call the trimmed Lasso and that offers exact control…

Methodology · Statistics 2017-08-16 Dimitris Bertsimas , Martin S. Copenhaver , Rahul Mazumder

Sparse linear regression is one of the classic problems in the field of statistics, which has deep connections and high intersections with optimization, computation, and machine learning. To address the effective handling of…

Methodology · Statistics 2025-08-04 Peili Li , Zhuomei Li , Yunhai Xiao , Chao Ying , Zhou Yu

The generalized Pareto distribution (GPD) is a fundamental model for analyzing the tail behavior of a distribution. In particular, the shape parameter of the GPD characterizes the extremal properties of the distribution. As described in…

Methodology · Statistics 2026-02-18 Takuma Yoshida , Koki Momoki , Shuichi Kawano

Distributed estimation methods have recently been used to compute the maximum likelihood estimate of the precision matrix for large graphical Gaussian models. Our aim, in this paper, is to give a Bayesian estimate of the precision matrix…

Methodology · Statistics 2016-05-30 Qiong Li , Xin Gao , Helene Massam

This article explores the estimation of precision matrices in high-dimensional Gaussian graphical models. We address the challenge of improving the accuracy of maximum likelihood-based precision estimation through penalization.…

Methodology · Statistics 2023-12-27 A. Bekker , A. Kheyri , M. Arashi

We consider the problem of learning a sparse graph underlying an undirected Gaussian graphical model, a key problem in statistical machine learning. Given $n$ samples from a multivariate Gaussian distribution with $p$ variables, the goal is…

Machine Learning · Computer Science 2026-04-07 Kayhan Behdin , Wenyu Chen , Rahul Mazumder

There exists a plethora of techniques for inducing structured sparsity in parametric models during the optimization process, with the final goal of resource-efficient inference. However, few methods target a specific number of…

Machine Learning · Computer Science 2018-11-26 Raphael Tang , Ashutosh Adhikari , Jimmy Lin

The time-evolving precision matrix of a piecewise-constant Gaussian graphical model encodes the dynamic conditional dependency structure of a multivariate time-series. Traditionally, graphical models are estimated under the assumption that…

Methodology · Statistics 2017-11-01 Alexander J. Gibberd , James D. B. Nelson

We consider the problem of learning a sparse graph under the Laplacian constrained Gaussian graphical models. This problem can be formulated as a penalized maximum likelihood estimation of the Laplacian constrained precision matrix. Like in…

Machine Learning · Computer Science 2023-09-06 Jiaxi Ying , José Vinícius de M. Cardoso , Daniel P. Palomar

We study the problem of learning a directed acyclic graph from data generated according to an additive, non-linear structural equation model with Gaussian noise. We express each non-linear function through a basis expansion, and derive a…

Methodology · Statistics 2025-11-27 Xiaozhu Zhang , Nir Keret , Ali Shojaie , Armeen Taeb

Sparsity-constrained optimization is an important and challenging problem that has wide applicability in data mining, machine learning, and statistics. In this paper, we focus on sparsity-constrained optimization in cases where the cost…

Machine Learning · Computer Science 2016-12-19 Feng Chen , Baojian Zhou

Estimation of a high dimensional precision matrix is a critical problem to many areas of statistics including Gaussian graphical models and inference on high dimensional data. Working under the structural assumption of sparsity, we propose…

Methodology · Statistics 2020-12-17 Adam B Kashlak

In the context of undirected Gaussian graphical models, we introduce three estimators based on elastic net penalty for the underlying dependence graph. Our goal is to estimate the sparse precision matrix, from which to retrieve both the…

Methodology · Statistics 2021-02-02 Davide Bernardini , Sandra Paterlini , Emanuele Taufer

Precision matrix estimation is an important problem in statistical data analysis. This paper introduces a fast sparse precision matrix estimation algorithm, namely GISS$^{{\rho}}$, which is originally introduced for compressive sensing. The…

Statistics Theory · Mathematics 2019-07-02 Didi Lv , Xiaoqun Zhang

Bayesian methodologies prioritising accurate associations above sparsity in Gaussian graphical model (GGM) estimation remain relatively scarce in scientific literature. It is well accepted that the $\ell_2$ penalty enjoys a smaller…

Methodology · Statistics 2022-10-31 J. Smith , M. Arashi , A. Bekker

We propose a penalized likelihood framework for estimating multiple precision matrices from different classes. Most existing methods either incorporate no information on relationships between the precision matrices, or require this…

Machine Learning · Statistics 2020-03-03 Bradley S. Price , Aaron J. Molstad , Ben Sherwood

We derive an efficient method to perform clustering of nodes in Gaussian graphical models directly from sample data. Nodes are clustered based on the similarity of their network neighborhoods, with edge weights defined by partial…

Machine Learning · Computer Science 2019-10-08 Keith Dillon

Gaussian Graphical Models (GGMs) are widely used to infer conditional dependence structures in high-dimensional data. However, standard precision matrix estimators are highly sensitive to data contamination, such as extreme outliers and…

Applications · Statistics 2026-03-25 Canruo Shen , Xintong Ji , Qiong Li , Wenzhi Yang , Xiaoping Shi

This paper develops a new statistical inference theory for the precision matrix of high-frequency data in a high-dimensional setting. The focus is not only on point estimation but also on interval estimation and hypothesis testing for…

Statistics Theory · Mathematics 2020-05-20 Yuta Koike

Sparse Group LASSO (SGL) is a regularized model for high-dimensional linear regression problems with grouped covariates. SGL applies $l_1$ and $l_2$ penalties on the individual predictors and group predictors, respectively, to guarantee…

Statistics Theory · Mathematics 2022-02-23 Kan Chen , Zhiqi Bu , Shiyun Xu