English
Related papers

Related papers: The Influence Function of Graphical Lasso Estimato…

200 papers

Effect modification occurs when the effect of the treatment on an outcome varies according to the level of other covariates and often has important implications in decision making. When there are tens or hundreds of covariates, it becomes…

Methodology · Statistics 2021-11-23 Qingyuan Zhao , Dylan S. Small , Ashkan Ertefaie

This paper studies the statistical properties of the group Lasso estimator for high dimensional sparse quantile regression models where the number of explanatory variables (or the number of groups of explanatory variables) is possibly much…

Methodology · Statistics 2011-03-28 Kengo Kato

We consider situations where a user feeds her attributes to a machine learning method that tries to predict her best option based on a random sample of other users. The predictor is incentive-compatible if the user has no incentive to…

Econometrics · Economics 2021-09-07 Mehmet Caner , Kfir Eliaz

We propose a generalization of the lasso that allows the model coefficients to vary as a function of a general set of modifying variables. These modifiers might be variables such as gender, age or time. The paradigm is quite general, with…

Methodology · Statistics 2018-01-11 Robert Tibshirani , Jerome Friedman

We explore how violations of the often-overlooked standard assumption that the random effects model matrix in a linear mixed model is fixed (and thus independent of the random effects vector) can lead to bias in estimators of estimable…

Statistics Theory · Mathematics 2020-06-23 Andrew T. Karl , Dale L. Zimmerman

We analyze lensless imaging systems with estimation-theoretic techniques based on Fisher information. Our analysis evaluates multiple optical encoder designs on objects with varying sparsity, in the context of both Gaussian and Poisson…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Leyla A. Kabuli , Nalini M. Singh , Laura Waller

We study various constraints and conditions on the true coefficient vector and on the design matrix to establish non-asymptotic oracle inequalities for the prediction error, estimation accuracy and variable selection for the Lasso estimator…

Statistics Theory · Mathematics 2018-06-15 Niharika Gauraha

Recent work has focused on the problem of conducting linear regression when the number of covariates is very large, potentially greater than the sample size. To facilitate this, one useful tool is to assume that the model can be well…

Methodology · Statistics 2011-11-21 Zhou Fang

Many important problems can be modeled as a system of interconnected entities, where each entity is recording time-dependent observations or measurements. In order to spot trends, detect anomalies, and interpret the temporal dynamics of…

Machine Learning · Computer Science 2017-06-13 David Hallac , Youngsuk Park , Stephen Boyd , Jure Leskovec

Robust estimators of large covariance matrices are considered, comprising regularized (linear shrinkage) modifications of Maronna's classical M-estimators. These estimators provide robustness to outliers, while simultaneously being…

Statistics Theory · Mathematics 2018-07-04 Nicolas Auguin , David Morales-Jimenez , Matthew R. McKay , Romain Couillet

In this paper, we consider the Group Lasso estimator of the covariance matrix of a stochastic process corrupted by an additive noise. We propose to estimate the covariance matrix in a high-dimensional setting under the assumption that the…

Statistics Theory · Mathematics 2011-10-26 Jérémie Bigot , Rolando Biscay , Jean-Michel Loubes , Lilian Muniz Alvarez

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

Estimating graphical model structure from high-dimensional and undersampled data is a fundamental problem in many scientific fields. Existing approaches, such as GLASSO, latent variable GLASSO, and latent tree models, suffer from high…

Machine Learning · Statistics 2019-09-18 Greg Ver Steeg , Hrayr Harutyunyan , Daniel Moyer , Aram Galstyan

In life sciences, the experts generally use empirical knowledge to recode variables, choose interactions and perform selection by classical approach. The aim of this work is to perform automatic learning algorithm for variables selection…

Machine Learning · Statistics 2015-11-05 Bienvenue Kouwayè , Noël Fonton , Fabrice Rossi

Augmenting a smooth cost function with an $\ell_1$ penalty allows analysts to efficiently conduct estimation and variable selection simultaneously in sophisticated models and can be efficiently implemented using proximal gradient methods.…

Machine Learning · Statistics 2024-12-10 Nathan Wycoff , Lisa O. Singh , Ali Arab , Katharine M. Donato

The accuracy of probability distributions inferred using machine-learning algorithms heavily depends on data availability and quality. In practical applications it is therefore fundamental to investigate the robustness of a statistical…

Machine Learning · Statistics 2018-10-01 Christiane Goergen , Manuele Leonelli

We consider the problem of learning a Gaussian variational approximation to the posterior distribution for a high-dimensional parameter, where we impose sparsity in the precision matrix to reflect appropriate conditional independence…

Computation · Statistics 2019-04-23 Linda S. L. Tan , David J. Nott

This paper combines causal mediation analysis with double machine learning to control for observed confounders in a data-driven way under a selection-on-observables assumption in a high-dimensional setting. We consider the average indirect…

Econometrics · Economics 2021-02-17 Helmut Farbmacher , Martin Huber , Lukáš Lafférs , Henrika Langen , Martin Spindler

The edge structure of the graph defining an undirected graphical model describes precisely the structure of dependence between the variables in the graph. In many applications, the dependence structure is unknown and it is desirable to…

Machine Learning · Statistics 2018-08-01 Marina Vinyes , Guillaume Obozinski

This paper examines the issue of fairness in the estimation of graphical models (GMs), particularly Gaussian, Covariance, and Ising models. These models play a vital role in understanding complex relationships in high-dimensional data.…

Machine Learning · Computer Science 2024-11-11 Zhuoping Zhou , Davoud Ataee Tarzanagh , Bojian Hou , Qi Long , Li Shen