English
Related papers

Related papers: The Influence Function of Graphical Lasso Estimato…

200 papers

We study the problem of estimating causal effects under hidden confounding in the following unpaired data setting: we observe some covariates $X$ and an outcome $Y$ under different experimental conditions (environments) but do not observe…

Machine Learning · Statistics 2026-01-22 Felix Schur , Niklas Pfister , Peng Ding , Sach Mukherjee , Jonas Peters

This paper introduces the Sylvester graphical lasso (SyGlasso) that captures multiway dependencies present in tensor-valued data. The model is based on the Sylvester equation that defines a generative model. The proposed model complements…

Machine Learning · Statistics 2020-02-04 Yu Wang , Byoungwook Jang , Alfred Hero

The minimum divergence estimators have proved to be useful tools in the area of robust inference. The robustness of such estimators are measured using the classical Influence functions. However, in many complex situations like testing a…

Statistics Theory · Mathematics 2015-05-26 Abhik Ghosh

This paper investigates the effect of the design matrix on the ability (or inability) to estimate a sparse parameter in linear regression. More specifically, we characterize the optimal rate of estimation when the smallest singular value of…

Statistics Theory · Mathematics 2024-02-02 Reese Pathak , Cong Ma

Multivariate location and scatter matrix estimation is a cornerstone in multivariate data analysis. We consider this problem when the data may contain independent cellwise and casewise outliers. Flat data sets with a large number of…

Statistics Theory · Mathematics 2014-06-24 Claudio Agostinelli , Andy Leung , Victor J. Yohai , Ruben H. Zamar

The analysis of practical probabilistic models on the computer demands a convenient representation for the available knowledge and an efficient algorithm to perform inference. An appealing representation is the influence diagram, a network…

Artificial Intelligence · Computer Science 2013-04-15 Ross D. Shachter

The analysis of complex computer simulations, often involving functional data, presents unique statistical challenges. Conventional regression methods, such as function-on-function regression, typically associate functional outcomes with…

Methodology · Statistics 2026-02-11 R. Jacob Andros , Rajarshi Guhaniyogi , Devin Francom , Donatella Pasqualini

We study the accuracy of estimating the covariance and the precision matrix of a $D$-variate sub-Gaussian distribution along a prescribed subspace or direction using the finite sample covariance. Our results show that the estimation…

Statistics Theory · Mathematics 2021-01-14 Zeljko Kereta , Timo Klock

The least absolute shrinkage and selection operator (LASSO) is a popular technique for simultaneous estimation and model selection. There have been a lot of studies on the large sample asymptotic distributional properties of the LASSO…

Statistics Theory · Mathematics 2016-07-05 Rakshith Jagannath , Neelesh S Upadhye

Logistic models are studied as a tool to convert output from numerical weather forecasting systems (deterministic and ensemble) into probability forecasts for binary events. A logistic model obtains by putting the logarithmic odds ratio…

Atmospheric and Oceanic Physics · Physics 2009-01-29 Jochen Bröcker

This work presents two astonishing findings on neural networks learned for large-scale image classification. 1) Given a well-trained model, the logits predicted for some category can be directly obtained by linearly combining the…

Machine Learning · Computer Science 2022-11-23 Ruili Feng , Kecheng Zheng , Kai Zhu , Yujun Shen , Jian Zhao , Yukun Huang , Deli Zhao , Jingren Zhou , Michael Jordan , Zheng-Jun Zha

Precision matrix estimation is essential in various fields; yet it is challenging when samples for the target study are limited. Transfer learning can enhance estimation accuracy by leveraging data from related source studies. We propose…

Machine Learning · Statistics 2026-03-31 Boxin Zhao , Cong Ma , Mladen Kolar

Recently, a special case of precision matrix estimation based on a distributionally robust optimization (DRO) framework has been shown to be equivalent to the graphical lasso. From this formulation, a method for choosing the regularization…

Methodology · Statistics 2022-06-10 Chau Tran , Pedro Cisneros-Velarde , Sang-Yun Oh , Alexander Petersen

We consider the problem of estimating differences in two Gaussian graphical models (GGMs) which are known to have similar structure. The GGM structure is encoded in its precision (inverse covariance) matrix. In many applications one is…

Machine Learning · Statistics 2023-12-19 Jitendra K Tugnait

Many modern spatial models express the stochastic variation component as a basis expansion with random coefficients. Low rank models, approximate spectral decompositions, multiresolution representations, stochastic partial differential…

Methodology · Statistics 2019-02-20 Mitchell Krock , William Kleiber , Stephen Becker

In a polynomial regression model, the divisibility conditions implicit in polynomial hierarchy give way to a natural construction of constraints for the model parameters. We use this principle to derive versions of strong and weak hierarchy…

Computation · Statistics 2020-01-23 Hugo Maruri-Aguilar , Simon Lunagomez

The choice of the tuning parameter in the Lasso is central to its statistical performance in high-dimensional linear regression. In this work, we study tuning regimes under which the Lasso exhibits suboptimal prediction performance, in the…

Statistics Theory · Mathematics 2026-05-19 Guo Liu

Graphical models can represent a multivariate distribution in a convenient and accessible form as a graph. Causal models can be viewed as a special class of graphical models that not only represent the distribution of the observed system…

Methodology · Statistics 2017-06-29 Christina Heinze-Deml , Marloes H. Maathuis , Nicolai Meinshausen

A precision matrix is the inverse of a covariance matrix. In this paper, we study the problem of estimating the precision matrix with a known graphical structure under high-dimensional settings. We propose a simple estimator of the…

Statistics Theory · Mathematics 2021-07-15 Thien-Minh Le , Ping-Shou Zhong

The Shapley effects are global sensitivity indices: they quantify the impact of each input variable on the output variable in a model. In this work, we suggest new estimators of these sensitivity indices. When the input distribution is…

Statistics Theory · Mathematics 2020-02-14 Baptiste Broto , François Bachoc , Marine Depecker