English
Related papers

Related papers: Tensor Graphical Lasso (TeraLasso)

200 papers

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

The Lasso (Least Absolute Shrinkage and Selection Operator) has been a popular technique for simultaneous linear regression estimation and variable selection. In this paper, we propose a new novel approach for robust Lasso that follows the…

Methodology · Statistics 2016-05-13 Esa Ollila

We address the problem of robust estimation of sparse high dimensional tensor elliptical graphical model. Most of the research focus on tensor graphical model under normality. To extend the tensor graphical model to more heavy-tailed…

Methodology · Statistics 2025-08-04 Jixuan Liu , Zhengke Lu , Le Zhou , Long Feng , Zhaojun Wang

We introduce c-lasso, a Python package that enables sparse and robust linear regression and classification with linear equality constraints. The underlying statistical forward model is assumed to be of the following form: \[ y = X \beta +…

Computation · Statistics 2020-11-03 Léo Simpson , Patrick L. Combettes , Christian L. Müller

The graphical Lasso (GLASSO) is a widely used algorithm for learning high-dimensional undirected Gaussian graphical models (GGM). Given i.i.d. observations from a multivariate normal distribution, GLASSO estimates the precision matrix by…

Methodology · Statistics 2026-01-15 Ha Nguyen , Sumanta Basu

Tensor factorization is a powerful tool to analyse multi-way data. Compared with traditional multi-linear methods, nonlinear tensor factorization models are capable of capturing more complex relationships in the data. However, they are…

Machine Learning · Computer Science 2016-05-24 Shandian Zhe , Kai Zhang , Pengyuan Wang , Kuang-chih Lee , Zenglin Xu , Yuan Qi , Zoubin Ghahramani

This paper studies high-dimensional regression models with lasso when data is sampled under multi-way clustering. First, we establish convergence rates for the lasso and post-lasso estimators. Second, we propose a novel inference method…

Econometrics · Economics 2019-08-22 Harold D. Chiang , Yuya Sasaki

Vector autoregressions (VARs) are popular model for analyzing multivariate economic time series. However, VARs can be over-parameterized if the numbers of variables and lags are moderately large. Tensor VAR, a recent solution to…

Methodology · Statistics 2024-09-13 Yiyong Luo , Jim E. Griffin

It is well-known that the statistical performance of Lasso can suffer significantly when the covariates of interest have strong correlations. In particular, the prediction error of Lasso becomes much worse than computationally inefficient…

Machine Learning · Statistics 2024-02-26 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

Decoding complex relationships among large numbers of variables with relatively few observations is one of the crucial issues in science. One approach to this problem is Gaussian graphical modeling, which describes conditional independence…

Methodology · Statistics 2019-04-26 A. Mohammadi , E. C. Wit

We introduce GGLasso, a Python package for solving General Graphical Lasso problems. The Graphical Lasso scheme, introduced by (Friedman 2007) (see also (Yuan 2007; Banerjee 2008)), estimates a sparse inverse covariance matrix $\Theta$ from…

Computation · Statistics 2021-10-22 Fabian Schaipp , Christian L. Müller , Oleg Vlasovets

This paper introduces Polynomial Graphical Lasso (PGL), a new approach to learning graph structures from nodal signals. Our key contribution lies in modeling the signals as Gaussian and stationary on the graph, enabling the development of a…

Signal Processing · Electrical Eng. & Systems 2024-04-04 Andrei Buciulea , Jiaxi Ying , Antonio G. Marques , Daniel P. Palomar

While multilinear algebra appears natural for studying the multiway interactions modeled by hypergraphs, tensor methods for general hypergraphs have been stymied by theoretical and practical barriers. A recently proposed adjacency tensor is…

Numerical Analysis · Mathematics 2024-04-05 Sinan G. Aksoy , Ilya Amburg , Stephen J. Young

Gaussian graphical models are a popular tool to learn the dependence structure in the form of a graph among variables of interest. Bayesian methods have gained in popularity in the last two decades due to their ability to simultaneously…

Statistics Theory · Mathematics 2019-04-02 Yabo Niu , Debdeep Pati , Bani Mallick

Tensor-based representations are being increasingly used to represent complex data types such as imaging data, due to their appealing properties such as dimension reduction and the preservation of spatial information. Recently, there is a…

Methodology · Statistics 2023-12-15 Rongke Lyu , Marina Vannucci , Suprateek Kundu

Tucker tensor decomposition offers a more effective representation for multiway data compared to the widely used PARAFAC model. However, its flexibility brings the challenge of selecting the appropriate latent multi-rank. To overcome the…

Methodology · Statistics 2025-05-19 Federica Stolf , Antonio Canale

A new unbiased Monte Carlo technique called Tensor Network Monte Carlo (TNMC) is introduced based on sampling all possible renormalizations (or course-grainings) of tensor networks, in this case matrix-product states. Tensor networks are a…

Statistical Mechanics · Physics 2015-07-06 Andrew J. Ferris

The graphical lasso (glasso) is a widely-used fast algorithm for estimating sparse inverse covariance matrices. The glasso solves an L1 penalized maximum likelihood problem and is available as an R library on CRAN. The output from the…

Machine Learning · Statistics 2012-07-25 Benjamin T. Rolfs , Bala Rajaratnam

Nonparametric extension of tensor regression is proposed. Nonlinearity in a high-dimensional tensor space is broken into simple local functions by incorporating low-rank tensor decomposition. Compared to naive nonparametric approaches, our…

Machine Learning · Statistics 2016-03-09 Masaaki Imaizumi , Kohei Hayashi

The estimation of a precision matrix is a crucial problem in various research fields, particularly when working with high dimensional data. In such settings, the most common approach is to use the penalized maximum likelihood. The…

Methodology · Statistics 2025-01-10 Vahe Avagyan