English
Related papers

Related papers: SIGLE: a valid procedure for Selective Inference w…

200 papers

Generalized Linear Models (GLM) form a wide class of regression and classification models, where prediction is a function of a linear combination of the input variables. For statistical inference in high dimension, sparsity inducing…

Machine Learning · Statistics 2022-08-25 Mathurin Massias , Samuel Vaiter , Alexandre Gramfort , Joseph Salmon

Quantile regression has been successfully used to study heterogeneous and heavy-tailed data. Varying-coefficient models are frequently used to capture changes in the effect of input variables on the response as a function of an index or…

Methodology · Statistics 2021-10-18 Ran Dai , Mladen Kolar

Penalized regression methods, most notably the lasso, are a popular approach to analyzing high-dimensional data. An attractive property of the lasso is that it naturally performs variable selection. An important area of concern, however, is…

Methodology · Statistics 2026-05-13 Ryan Miller , Patrick Breheny

This paper considers errors-in-variables models in a high-dimensional setting where the number of covariates can be much larger than the sample size, and there are only a small number of non-zero covariates. The presence of measurement…

Methodology · Statistics 2018-09-03 Linh Nghiem , Cornelis Potgieter

Generalized Linear Models (GLMs) and Single Index Models (SIMs) provide powerful generalizations of linear regression, where the target variable is assumed to be a (possibly unknown) 1-dimensional function of a linear predictor. In general,…

Artificial Intelligence · Computer Science 2011-04-14 Sham Kakade , Adam Tauman Kalai , Varun Kanade , Ohad Shamir

Let X; Z be r and s-dimensional covariates, respectively, used to model the response variable Y as Y = m(X;Z) + \sigma(X;Z)\epsilon. We develop an ANOVA-type test for the null hypothesis that Z has no influence on the regression function,…

Methodology · Statistics 2016-11-11 Adriano Zanin Zambom , Michael G. Akritas

Accurate uncertainty quantification is crucial for making reliable decisions in various supervised learning scenarios, particularly when dealing with complex, multimodal data such as images and text. Current approaches often face notable…

Machine Learning · Statistics 2026-03-30 Xinyu Tian , Xiaotong Shen

In this paper we develop an online statistical inference approach for high-dimensional generalized linear models with streaming data for real-time estimation and inference. We propose an online debiased lasso (ODL) method to accommodate the…

Statistics Theory · Mathematics 2021-08-11 Lan Luo , Ruijian Han , Yuanyuan Lin , Jian Huang

High-dimensional data sets have become ubiquitous in the past few decades, often with many more covariates than observations. In the frequentist setting, penalized likelihood methods are the most popular approach for variable selection and…

Methodology · Statistics 2021-12-14 Ray Bai , Veronika Rockova , Edward I. George

We introduce GAMSEL (Generalized Additive Model Selection), a penalized likelihood approach for fitting sparse generalized additive models in high dimension. Our method interpolates between null, linear and additive models by allowing the…

Machine Learning · Statistics 2015-06-18 Alexandra Chouldechova , Trevor Hastie

We consider the linear regression problem. We propose the S-Lasso procedure to estimate the unknown regression parameters. This estimator enjoys sparsity of the representation while taking into account correlation between successive…

Statistics Theory · Mathematics 2008-10-15 Mohamed Hebiri

This paper proposes a general framework for penalized convex empirical criteria and a new version of the Sparse-Group LASSO (SGL, Simon and al., 2013), called the adaptive SGL, where both penalties of the SGL are weighted by preliminary…

Statistics Theory · Mathematics 2016-12-01 Benjamin Poignard

High-dimensional linear models have been widely studied, but the developments in high-dimensional generalized linear models, or GLMs, have been slower. In this paper, we propose an empirical or data-driven prior leading to an empirical…

Statistics Theory · Mathematics 2025-07-09 Yiqi Tang , Ryan Martin

This work addresses the problem of high-dimensional classification by exploring the generalized Bayesian logistic regression method under a sparsity-inducing prior distribution. The method involves utilizing a fractional power of the…

Statistics Theory · Mathematics 2024-03-20 The Tien Mai

Estimation of structure, such as in variable selection, graphical modelling or cluster analysis is notoriously difficult, especially for high-dimensional data. We introduce stability selection. It is based on subsampling in combination with…

Methodology · Statistics 2009-05-16 Nicolai Meinshausen , Peter Buehlmann

Bayesian synthetic likelihood (BSL) is now an established method for conducting approximate Bayesian inference in models where, due to the intractability of the likelihood function, exact Bayesian approaches are either infeasible or…

Methodology · Statistics 2020-06-12 David T. Frazier , Christopher Drovandi

Generalized linear regressions, such as logistic regressions or Poisson regressions, are long-studied regression analysis approaches, and their applications are widely employed in various classification problems. Our study considers a…

Machine Learning · Statistics 2024-01-17 Vu Duc Anh , Tran Anh Tuan , Tran Ngoc Thang , Nguyen Thi Ngoc Anh

Regression models are popular tools in empirical sciences to infer the influence of a set of variables onto a dependent variable given an experimental dataset. In neuroscience and cognitive psychology, Generalized Linear Models (GLMs)…

Applications · Statistics 2020-02-04 Vincent Adam , Alexandre Hyafil

This paper studies variable selection and post-selection inference for high-dimensional clustered data using marginal-model-based procedures. We show that, when covariates are heterogeneously distributed across clusters, marginal-model…

Methodology · Statistics 2026-05-26 Shangyuan Ye , Cong Zhang , Ying Chen , Ye Liang , Guanbo Wang

Online statistical inference facilitates real-time analysis of sequentially collected data, making it different from traditional methods that rely on static datasets. This paper introduces a novel approach to online inference in…

Machine Learning · Statistics 2025-02-27 Ruijian Han , Lan Luo , Yuanhang Luo , Yuanyuan Lin , Jian Huang
‹ Prev 1 3 4 5 6 7 10 Next ›