English
Related papers

Related papers: Monotone Splines Lasso

200 papers

We propose a new sparse regression method called the component lasso, based on a simple idea. The method uses the connected-components structure of the sample covariance matrix to split the problem into smaller ones. It then solves the…

Machine Learning · Statistics 2013-12-10 Nadine Hussami , Robert Tibshirani

Sparse linear models are one of several core tools for interpretable machine learning, a field of emerging importance as predictive models permeate decision-making in many domains. Unfortunately, sparse linear models are far less flexible…

Machine Learning · Statistics 2024-01-03 Ryan Thompson , Amir Dezfouli , Robert Kohn

The purpose of this article is to provide an adaptive estimator of the baseline function in the Cox model with high-dimensional covariates. We consider a two-step procedure : first, we estimate the regression parameter of the Cox model via…

Statistics Theory · Mathematics 2015-03-04 Agathe Guilloux , Sarah Lemler , Marie-Luce Taupin

Grouping structures arise naturally in many statistical modeling problems. Several methods have been proposed for variable selection that respect grouping structure in variables. Examples include the group LASSO and several concave group…

Statistics Theory · Mathematics 2013-01-07 Jian Huang , Patrick Breheny , Shuangge Ma

When we are interested in high-dimensional system and focus on classification performance, the $\ell_{1}$-penalized logistic regression is becoming important and popular. However, the Lasso estimates could be problematic when penalties of…

Machine Learning · Statistics 2020-06-12 Huamei Huang , Yujing Gao , Huiming Zhang , Bo Li

We provide a principled way for investigators to analyze randomized experiments when the number of covariates is large. Investigators often use linear multivariate regression to analyze randomized experiments instead of simply reporting the…

Statistics Theory · Mathematics 2022-06-08 Adam Bloniarz , Hanzhong Liu , Cun-Hui Zhang , Jasjeet Sekhon , Bin Yu

We consider the problem of identifying significant predictors in large data bases, where the response variable depends on the linear combination of explanatory variables through an unknown link function, corrupted with the noise from the…

Methodology · Statistics 2019-11-19 Wojciech Rejchel , Malgorzata Bogdan

We present an estimation procedure for nonlinear mixed-effects models in which the population trajectory is represented by penalized splines and adapted to individuals via subject-specific transformation parameters. By exploiting the mixed…

Methodology · Statistics 2026-03-13 Matteo D'Alessandro , Magne Thoresen , Øystein Sørensen

Comparative meta-analyses of groups of subjects by integrating multiple observational studies rely on estimated propensity scores (PSs) to mitigate covariate imbalances. However, PS estimation grapples with the theoretical and practical…

Methodology · Statistics 2024-05-09 Subharup Guha , Yi Li

We consider a linear regression problem in a high dimensional setting where the number of covariates $p$ can be much larger than the sample size $n$. In such a situation, one often assumes sparsity of the regression vector, \textit i.e.,…

Statistics Theory · Mathematics 2011-10-12 Mohamed Hebiri , Sara A. Van De Geer

We propose a novel method to model nonlinear regression problems by adapting the principle of penalization to Partial Least Squares (PLS). Starting with a generalized additive model, we expand the additive component of each variable in…

Statistics Theory · Mathematics 2010-08-13 Nicole Kraemer , Anne-Laure Boulesteix , Gerhard Tutz

Selective inference methods are developed for group lasso estimators for use with a wide class of distributions and loss functions. The method includes the use of exponential family distributions, as well as quasi-likelihood modeling for…

Methodology · Statistics 2024-03-28 Yiling Huang , Sarah Pirenne , Snigdha Panigrahi , Gerda Claeskens

Detecting influential features in non-linear and/or high-dimensional data is a challenging and increasingly important task in machine learning. Variable selection methods have thus been gaining much attention as well as post-selection…

Statistics Theory · Mathematics 2021-06-18 Tobias Freidling , Benjamin Poignard , Héctor Climente-González , Makoto Yamada

Modern biomedical studies frequently collect complex, high-dimensional physiological signals using wearables and sensors along with time-to-event outcomes, making efficient variable selection methods crucial for interpretation and improving…

Methodology · Statistics 2026-04-22 Yuanzhen Yue , Stella Self , Yichao Wu , Jiajia Zhang , Rahul Ghosal

Optimization problems with the objective function in the form of weighted sum and linear equality constraints are considered. Given that the number of local cost functions can be large as well as the number of constraints, a stochastic…

Optimization and Control · Mathematics 2026-05-26 Nataša Krejić , Nataša Krklec Jerinkić , Sanja Rapajić , Luka Rutešić

We consider the problem of non-parametric regression with a potentially large number of covariates. We propose a convex, penalized estimation framework that is particularly well-suited for high-dimensional sparse additive models. The…

Methodology · Statistics 2019-06-19 Asad Haris , Ali Shojaie , Noah Simon

Penalized regression is an attractive framework for variable selection problems. Often, variables possess a grouping structure, and the relevant selection problem is that of selecting groups, not individual variables. The group lasso has…

Computation · Statistics 2016-07-20 Patrick Breheny , Jian Huang

Motivated by recent data analyses in biomedical imaging studies, we consider a class of image-on-scalar regression models for imaging responses and scalar predictors. We propose using flexible multivariate splines over triangulations to…

Methodology · Statistics 2021-06-04 Shan Yu , Guannan Wang , Li Wang , Lijian Yang

In this paper, for Lasso penalized linear regression models in high-dimensional settings, we propose a modified cross-validation method for selecting the penalty parameter. The methodology is extended to other penalties, such as Elastic…

Methodology · Statistics 2013-09-10 Yi Yu , Yang Feng

Nonparametric varying coefficient (NVC) models are useful for modeling time-varying effects on responses that are measured repeatedly for the same subjects. When the number of covariates is moderate or large, it is desirable to perform…

Methodology · Statistics 2023-09-19 Ray Bai , Mary R. Boland , Yong Chen
‹ Prev 1 4 5 6 7 8 10 Next ›