English
Related papers

Related papers: Stability Selection for Structured Variable Select…

200 papers

Many data sets consist of variables with an inherent group structure. The problem of group selection has been well studied, but in this paper, we seek to do the opposite: our goal is to select at least one variable from each group in the…

Methodology · Statistics 2015-05-29 Frederick Campbell , Genevera I. Allen

In this article we investigate consistency of selection in regression models via the popular Lasso method. Here we depart from the traditional linear regression assumption and consider approximations of the regression function $f$ with…

Statistics Theory · Mathematics 2008-12-18 Florentina Bunea

High-dimensional predictive models, those with more measurements than observations, require regularization to be well defined, perform well empirically, and possess theoretical guarantees. The amount of regularization, often determined by…

Methodology · Statistics 2019-07-16 Darren Homrighausen , Daniel J. McDonald

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

Machine Learning · Computer Science 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

Conformal prediction (CP) is an important tool for distribution-free predictive uncertainty quantification. Yet, a major challenge is to balance computational efficiency and prediction accuracy, particularly for multiple predictions. We…

Machine Learning · Statistics 2025-04-17 Kiljae Lee , Yuan Zhang

Most scientific publications follow the familiar recipe of (i) obtain data, (ii) fit a model, and (iii) comment on the scientific relevance of the effects of particular covariates in that model. This approach, however, ignores the fact that…

Methodology · Statistics 2021-03-08 Nicholas Kissel , Lucas Mentch

This paper uses the notion of algorithmic stability to derive novel generalization bounds for several families of transductive regression algorithms, both by using convexity and closed-form solutions. Our analysis helps compare the…

Machine Learning · Computer Science 2009-04-07 Corinna Cortes , Mehryar Mohri , Dmitry Pechyony , Ashish Rastogi

Shrinkage estimators that possess the ability to produce sparse solutions have become increasingly important to the analysis of today's complex datasets. Examples include the LASSO, the Elastic-Net and their adaptive counterparts.…

Methodology · Statistics 2017-02-09 Hongmei Liu , J. Sunil Rao

In high dimensional settings, sparse structures are crucial for efficiency, both in term of memory, computation and performance. It is customary to consider $\ell_1$ penalty to enforce sparsity in such scenarios. Sparsity enforcing methods,…

Machine Learning · Statistics 2017-11-22 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Vincent Leclère , Joseph Salmon

Optimization under uncertainty and risk is indispensable in many practical situations. Our paper addresses stability of optimization problems using composite risk functionals which are subjected to measure perturbations. Our main focus is…

Optimization and Control · Mathematics 2022-01-06 Darinka Dentcheva , Yang Lin , Spiridon Penev

Stability selection has gained popularity as a method for enhancing the performance of variable selection algorithms while controlling false discovery rates. However, achieving these desirable properties depends on correctly specifying the…

Methodology · Statistics 2026-01-13 Martin Huang , Samuel Muller , Garth Tarr

This work proposes a notion of robust reachability of one set from another set under constant control. This notion is used to construct a control strategy, involving sequential set-to-set reachability, which guarantees robust global…

Optimization and Control · Mathematics 2007-11-21 Iasson Karafyllis , Costas Kravaris

Stably placing an object in a multi-object scene is a fundamental challenge in robotic manipulation, as placements must be penetration-free, establish precise surface contact, and result in a force equilibrium. To assess stability, existing…

Robotics · Computer Science 2025-09-29 Philippe Nadeau , Miguel Rogel , Ivan Bilić , Ivan Petrović , Jonathan Kelly

It is preferred that feature selectors be \textit{stable} for better interpretabity and robust prediction. Ensembling is known to be effective for improving the stability of feature selectors. Since ensembling is time-consuming, it is…

Machine Learning · Computer Science 2021-08-04 Rina Onda , Zhengyan Gao , Masaaki Kotera , Kenta Oono

As the use of machine learning in high impact domains becomes widespread, the importance of evaluating safety has increased. An important aspect of this is evaluating how robust a model is to changes in setting or population, which…

Machine Learning · Computer Science 2021-03-16 Adarsh Subbaswamy , Roy Adams , Suchi Saria

Model selection is difficult to analyse yet theoretically and empirically important, especially for high-dimensional data analysis. Recently the least absolute shrinkage and selection operator (Lasso) has been applied in the statistical and…

Machine Learning · Statistics 2016-06-02 Ning Xu , Jian Hong , Timothy C. G. Fisher

Relevant methods of variable selection have been proposed in model-based clustering and classification. These methods are making use of backward or forward procedures to define the roles of the variables. Unfortunately, these stepwise…

Computation · Statistics 2017-05-03 Gilles Celeux , Cathy Maugis-Rabusseau , Mohammed Sedki

Variational stability, in the sense of local good behavior of optimal values and solutions in problems of optimization under shifts in parameters, is important not only for validating model robustness in practical applications but also for…

Optimization and Control · Mathematics 2026-02-24 Matúš Benko , R. Tyrrell Rockafellar

We study a generalized framework for structured sparsity. It extends the well-known methods of Lasso and Group Lasso by incorporating additional constraints on the variables as part of a convex optimization problem. This framework provides…

Machine Learning · Computer Science 2011-06-28 Andreas Argyriou , Luca Baldassarre , Jean Morales , Massimiliano Pontil

The "least absolute shrinkage and selection operator" (Lasso) method has been adapted recently for networkstructured datasets. In particular, this network Lasso method allows to learn graph signals from a small number of noisy signal…

Machine Learning · Statistics 2017-12-19 Alexander Jung , Nguyen Tran Quang , Alexandru Mara
‹ Prev 1 3 4 5 6 7 10 Next ›