English
Related papers

Related papers: High-Dimensional Sparse Additive Hazards Regressio…

200 papers

Here we propose a novel searching scheme for a tuning parameter in high-dimensional penalized regression methods to address variable selection and modeling when sample sizes are limited compared to the data dimensions. Our method is…

Quantitative Methods · Quantitative Biology 2020-02-11 Tao Jiang , Stephanie J. London , Mi Kyeong Lee , Josyf C. Mychaleckyj , Alison A. Motsinger-Reif

Popular sparse estimation methods based on $\ell_1$-relaxation, such as the Lasso and the Dantzig selector, require the knowledge of the variance of the noise in order to properly tune the regularization parameter. This constitutes a major…

Machine Learning · Statistics 2013-04-17 Arnak S. Dalalyan , Mohamed Hebiri , Katia Méziani , Joseph Salmon

High-dimensional data pose challenges in statistical learning and modeling. Sometimes the predictors can be naturally grouped where pursuing the between-group sparsity is desired. Collinearity may occur in real-world high-dimensional…

Machine Learning · Statistics 2011-11-11 Yiyuan She

We study the problem of learning high dimensional regression models regularized by a structured-sparsity-inducing penalty that encodes prior structural information on either input or output sides. We consider two widely adopted types of…

Machine Learning · Computer Science 2012-02-20 Xi Chen , Qihang Lin , Seyoung Kim , Jaime G. Carbonell , Eric P. Xing

In the field of data mining, how to deal with high-dimensional data is an inevitable problem. Unsupervised feature selection has attracted more and more attention because it does not rely on labels. The performance of spectral-based…

Machine Learning · Computer Science 2021-01-01 Zhengxin Li , Feiping Nie , Jintang Bian , Xuelong Li

High dimensional statistical problems arise from diverse fields of scientific research and technological development. Variable selection plays a pivotal role in contemporary statistical learning and scientific discoveries. The traditional…

Statistics Theory · Mathematics 2009-10-08 Jianqing Fan , Jinchi Lv

In this work we consider numerical efficiency and convergence rates for solvers of non-convex multi-penalty formulations when reconstructing sparse signals from noisy linear measurements. We extend an existing approach, based on reduction…

Information Theory · Computer Science 2021-01-15 Zeljko Kereta , Johannes Maly , Valeriya Naumova

The two primary approaches for high-dimensional regression problems are sparse methods (e.g., best subset selection, which uses the L0-norm in the penalty) and ensemble methods (e.g., random forests). Although sparse methods typically yield…

Methodology · Statistics 2024-10-31 Anthony-Alexander Christidis , Stefan Van Aelst , Ruben Zamar

For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't…

Methodology · Statistics 2022-09-29 Xin Xin , Boyi Xie , Yunhai Xiao

In a plethora of applications dealing with inverse problems, e.g. in image processing, social networks, compressive sensing, biological data processing etc., the signal of interest is known to be structured in several ways at the same time.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Paris Giampouras , Konstantinos Themelis , Athanasios Rontogiannis , Konstantinos Koutroumbas

High-dimensional data sets are often analyzed and explored via the construction of a latent low-dimensional space which enables convenient visualization and efficient predictive modeling or clustering. For complex data structures, linear…

Machine Learning · Computer Science 2022-05-25 Oskar Allerbo , Rebecka Jörnsten

In exact sparse optimization problems on Rd (also known as sparsity constrained problems), one looks for solution that have few nonzero components. In this paper, we consider problems where sparsity is exactly measured either by the…

Optimization and Control · Mathematics 2019-02-14 Jean-Philippe Chancelier , Michel De Lara , Ponts Paristech

Quantile regression, a robust method for estimating conditional quantiles, has advanced significantly in fields such as econometrics, statistics, and machine learning. In high-dimensional settings, where the number of covariates exceeds…

Machine Learning · Statistics 2024-09-04 The Tien Mai

We investigate high-dimensional nonconvex penalized regression, where the number of covariates may grow at an exponential rate. Although recent asymptotic theory established that there exists a local minimum possessing the oracle property…

Statistics Theory · Mathematics 2013-11-21 Lan Wang , Yongdai Kim , Runze Li

Statistical inference of the high-dimensional regression coefficients is challenging because the uncertainty introduced by the model selection procedure is hard to account for. A critical question remains unsettled; that is, is it possible…

Methodology · Statistics 2025-01-06 Xiaorui Zhu , Yichen Qin , Peng Wang

Sparse high dimensional graphical model selection is a popular topic in contemporary machine learning. To this end, various useful approaches have been proposed in the context of $\ell_1$-penalized estimation in the Gaussian framework.…

Computation · Statistics 2022-02-04 Sang-Yun Oh , Onkar Dalal , Kshitij Khare , Bala Rajaratnam

We consider the problem of simultaneous variable selection and estimation of the corresponding regression coefficients in an ultra-high dimensional linear regression models, an extremely important problem in the recent era. The adaptive…

Methodology · Statistics 2023-09-22 Abhik Ghosh , Maria Jaenada , Leandro Pardo

Sparse regression models are increasingly prevalent due to their ease of interpretability and superior out-of-sample performance. However, the exact model of sparse regression with an $\ell_0$ constraint restricting the support of the…

Machine Learning · Statistics 2020-10-20 Alper Atamturk , Andres Gomez

We consider a flexible semiparametric quantile regression model for analyzing high dimensional heterogeneous data. This model has several appealing features: (1) By considering different conditional quantiles, we may obtain a more complete…

Statistics Theory · Mathematics 2016-01-25 Ben Sherwood , Lan Wang

We investigate fast methods that allow to quickly eliminate variables (features) in supervised learning problems involving a convex loss function and a $l_1$-norm penalty, leading to a potentially substantial reduction in the number of…

Machine Learning · Computer Science 2010-10-28 Laurent El Ghaoui , Vivian Viallon , Tarek Rabbani
‹ Prev 1 3 4 5 6 7 10 Next ›