English
Related papers

Related papers: Robust and Sparse Multinomial Regression in High D…

200 papers

A reduced-rank mixed effects model is developed for robust modeling of sparsely observed paired functional data. In this model, the curves for each functional variable are summarized using a few functional principal components, and the…

Methodology · Statistics 2023-08-08 Huiya Zhou , Xiaomeng Yan , Lan Zhou

In this work, we propose an optimization framework for estimating a sparse robust one-dimensional subspace. Our objective is to minimize both the representation error and the penalty, in terms of the l1-norm criterion. Given that the…

Machine Learning · Statistics 2024-03-07 Xiao Ling , Paul Brooks

Among semiparametric regression models, partially linear additive models provide a useful tool to include additive nonparametric components as well as a parametric component, when explaining the relationship between the response and a set…

Methodology · Statistics 2024-02-01 Graciela Boente , Alejandra Martínez

High-dimensional sparse modeling with censored survival data is of great practical importance, as exemplified by modern applications in high-throughput genomic data analysis and credit risk analysis. In this article, we propose a class of…

Methodology · Statistics 2014-03-19 Wei Lin , Jinchi Lv

The Huber's criterion is a useful method for robust regression. The adaptive least absolute shrinkage and selection operator (lasso) is a popular technique for simultaneous estimation and variable selection. In the case of small sample size…

Statistics Theory · Mathematics 2012-07-31 Laurent Zwald , Sophie Lambert-Lacroix

We present estimators for a well studied statistical estimation problem: the estimation for the linear regression model with soft sparsity constraints ($\ell_q$ constraint with $0<q\leq1$) in the high-dimensional setting. We first present a…

Statistics Theory · Mathematics 2013-11-11 Li Zhang

We introduce and study a family of robust estimators for the functional logistic regression model whose robustness automatically adapts to the data thereby leading to estimators with high efficiency in clean data and a high degree of…

Methodology · Statistics 2023-05-03 Ioannis Kalogridis

We consider high-dimensional distribution estimation through autoregressive networks. By combining the concepts of sparsity, mixtures and parameter sharing we obtain a simple model which is fast to train and which achieves state-of-the-art…

Machine Learning · Statistics 2016-04-28 Marc Goessling , Yali Amit

The functional linear model is an important extension of the classical regression model allowing for scalar responses to be modeled as functions of stochastic processes. Yet, despite the usefulness and popularity of the functional linear…

Methodology · Statistics 2025-11-27 Ioannis Kalogridis , Stanislav Nagy

We propose a minimum distance estimation method for robust regression in sparse high-dimensional settings. The traditional likelihood-based estimators lack resilience against outliers, a critical issue when dealing with high-dimensional…

Methodology · Statistics 2013-07-12 Aurélie C. Lozano , Nicolai Meinshausen

High-dimensional learning problems, where the number of features exceeds the sample size, often require sparse regularization for effective prediction and variable selection. While established for fully supervised data, these techniques…

Machine Learning · Computer Science 2026-01-01 The Tien Mai , Mai Anh Nguyen , Trung Nghia Nguyen

The association between a continuous and an ordinal variable is commonly modeled through the polyserial correlation model. However, this model, which is based on a partially-latent normality assumption, may be misspecified in practice, due…

Methodology · Statistics 2026-02-11 Max Welz

We study functional regression with random subgaussian design and real-valued response. The focus is on the problems in which the regression function can be well approximated by a functional linear model with the slope function being…

Statistics Theory · Mathematics 2014-09-16 Vladimir Koltchinskii , Stanislav Minsker

Analysis of random censored life-time data along with some related stochastic covariables is of great importance in many applied sciences like medical research, population studies and planning etc. The parametric estimation technique…

Statistics Theory · Mathematics 2019-05-09 Abhik Ghosh , Ayanendranath Basu

In our paper, we focus on robust variable selection for missing data and measurement error. Missing data and measurement errors can lead to confusing data distribution. We propose an exponential loss function with a tuning parameter to…

Methodology · Statistics 2025-07-01 Zhenhao Zhang , Yunquan Song

The inflated beta regression model is widely used for modeling continuous proportions with values at the boundaries. Maximum likelihood estimation for these models is well-known for its sensitivity to outliers, which can severely distort…

Methodology · Statistics 2026-05-15 Francisco Felipe Queiroz , Silvia Lopes de Paula Ferrari

Statistical methods with empirical likelihood (EL) are appealing and effective especially in conjunction with estimating equations through which useful data information can be adaptively and flexibly incorporated. It is also known in the…

Statistics Theory · Mathematics 2018-12-21 Jinyuan Chang , Cheng Yong Tang , Tong Tong Wu

Estimation of a precision matrix (i.e., inverse covariance matrix) is widely used to exploit conditional independence among continuous variables. The influence of abnormal observations is exacerbated in a high dimensional setting as the…

Methodology · Statistics 2021-05-17 Peng Tang , Huijing Jiang , Heeyoung Kim , Xinwei Deng

In high dimension, it is customary to consider Lasso-type estimators to enforce sparsity. For standard Lasso theory to hold, the regularization parameter should be proportional to the noise level, yet the latter is generally unknown in…

Machine Learning · Statistics 2017-10-19 Mathurin Massias , Olivier Fercoq , Alexandre Gramfort , Joseph Salmon

We collect robust proposals given in the field of regression models with heteroscedastic errors. Our motivation stems from the fact that the practitioner frequently faces the confluence of two phenomena in the context of data analysis:…

Methodology · Statistics 2023-11-08 Conceição Amado , Ana M. Bianco , Graciela Boente , Isabel M. Rodrigues