English
Related papers

Related papers: Lasso and probabilistic inequalities for multivari…

200 papers

Lasso and Dantzig selector are standard procedures able to perform variable selection and estimation simultaneously. This paper is concerned with extending these procedures to spatial point process intensity estimation. We propose adaptive…

Methodology · Statistics 2022-05-24 Achmad Choiruddin , Jean-François Coeurjolly , Frédérique Letué

We consider the problem of unveiling the implicit network structure of node interactions (such as user interactions in a social network), based only on high-frequency timestamps. Our inference is based on the minimization of the…

Machine Learning · Statistics 2020-02-25 Emmanuel Bacry , Martin Bompaire , Stéphane Gaïffas , Jean-François Muzy

Effect modification occurs when the effect of the treatment on an outcome varies according to the level of other covariates and often has important implications in decision making. When there are tens or hundreds of covariates, it becomes…

Methodology · Statistics 2021-11-23 Qingyuan Zhao , Dylan S. Small , Ashkan Ertefaie

Inferring network structures remains an interesting question for its importance on the understanding and controlling collective dynamics of complex systems. The existing shrinking methods such as Lasso-type estimation can not suitably…

Statistics Theory · Mathematics 2025-09-03 Lei Shi , Jie Hu , Huaiyu Tan , Libin Jin , Wei Zhong , Chen Shen

In this paper, we present a nonparametric estimation procedure for the multivariate Hawkes point process. The timeline is cut into bins and -- for each component process -- the number of points in each bin is counted. The distribution of…

Probability · Mathematics 2022-08-18 Matthias Kirchner

The application of the lasso is espoused in high-dimensional settings where only a small number of the regression coefficients are believed to be nonzero. Moreover, statistical properties of high-dimensional lasso estimators are often…

Methodology · Statistics 2015-01-07 Bala Rajaratnam , Steven Roberts , Doug Sparks , Onkar Dalal

In recent years, there has been considerable theoretical development regarding variable selection consistency of penalized regression techniques, such as the lasso. However, there has been relatively little work on quantifying the…

Methodology · Statistics 2014-05-21 Arend Voorman , Ali Shojaie , Daniela Witten

We introduce a novel scheme for choosing the regularization parameter in high-dimensional linear regression with Lasso. This scheme, inspired by Lepski's method for bandwidth selection in non-parametric regression, is equipped with both…

Methodology · Statistics 2016-11-09 Michaël Chichignoud , Johannes Lederer , Martin Wainwright

Among the most popular variable selection procedures in high-dimensional regression, Lasso provides a solution path to rank the variables and determines a cut-off position on the path to select variables and estimate coefficients. In this…

Methodology · Statistics 2018-06-19 X. Jessie Jeng , Huimin Peng , Wenbin Lu

We study the estimation capacity of the generalized Lasso, i.e., least squares minimization combined with a (convex) structural constraint. While Lasso-type estimators were originally designed for noisy linear regression problems, it has…

Statistics Theory · Mathematics 2019-09-12 Martin Genzel , Gitta Kutyniok

We adopt the interpretability offered by a parametric, Hawkes-process-inspired conditional probability mass function for the marks and apply variational inference techniques to derive a general and scalable inferential framework for marked…

Machine Learning · Statistics 2023-02-21 Aristeidis Panos , Ioannis Kosmidis , Petros Dellaportas

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

This paper consider penalized empirical loss minimization of convex loss functions with unknown non-linear target functions. Using the elastic net penalty we establish a finite sample oracle inequality which bounds the loss of our estimator…

Statistics Theory · Mathematics 2013-12-13 Mehmet Caner , Anders Bredahl Kock

In the context of a linear model with a sparse coefficient vector, exponential weights methods have been shown to be achieve oracle inequalities for prediction. We show that such methods also succeed at variable selection and estimation…

Statistics Theory · Mathematics 2012-09-18 Ery Arias-Castro , Karim Lounici

The Lasso is a very well known penalized regression model, which adds an $L_{1}$ penalty with parameter $\lambda_{1}$ on the coefficients to the squared error loss function. The Fused Lasso extends this model by also putting an $L_{1}$…

Computation · Statistics 2009-10-06 Holger Hoefling

We consider a problem of model selection in high-dimensional binary Markov random fields. The usefulness of the Ising model in studying systems of complex interactions has been confirmed in many papers. The main drawback of this model is…

Methodology · Statistics 2018-12-11 Błażej Miasojedow , Wojciech Rejchel

The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables $p_n$ is potentially much larger than the number of samples $n$. However, it was recently…

Statistics Theory · Mathematics 2009-03-02 Nicolai Meinshausen , Bin Yu

This paper contributes to the literature on treatment effects estimation with machine learning inspired methods by studying the performance of different estimators based on the Lasso. Building on recent work in the field of high-dimensional…

Econometrics · Economics 2018-05-15 Michael Zimmert

Count data is prevalent in various fields like ecology, medical research, and genomics. In high-dimensional settings, where the number of features exceeds the sample size, feature selection becomes essential. While frequentist methods like…

Methodology · Statistics 2024-10-22 The Tien Mai

This paper compares convex and non-convex penalized likelihood methods in high-dimensional statistical modeling, focusing on their strengths and limitations. Convex penalties, like LASSO, offer computational efficiency and strong…

Methodology · Statistics 2025-02-26 Kasy Du