English
Related papers

Related papers: Stabilizing black-box model selection with the inf…

200 papers

Sparse model identification enables the discovery of nonlinear dynamical systems purely from data; however, this approach is sensitive to noise, especially in the low-data limit. In this work, we leverage the statistical approach of…

Numerical Analysis · Mathematics 2022-05-04 Urban Fasel , J. Nathan Kutz , Bingni W. Brunton , Steven L. Brunton

This paper introduces new techniques for using convex optimization to fit input-output data to a class of stable nonlinear dynamical models. We present an algorithm that guarantees consistent estimates of models in this class when a small…

Optimization and Control · Mathematics 2013-03-19 Mark M. Tobenkin , Ian R. Manchester , Alexandre Megretski

Stability selection is a widely adopted resampling-based framework for high-dimensional variable selection. This paper seeks to broaden the use of an established stability estimator to evaluate the overall stability of the stability…

Methodology · Statistics 2025-06-04 Mahdi Nouraie , Samuel Muller

Automated model selection is an important application in science and engineering. In this work, we develop a learning approach for identifying structured dynamical systems from undersampled and noisy spatiotemporal data. The learning is…

Machine Learning · Statistics 2023-05-31 Xiaofan Lu , Linan Zhang , Hongjin He

This paper studies model selection consistency for high dimensional sparse regression when data exhibits both cross-sectional and serial dependency. Most commonly-used model selection methods fail to consistently recover the true model when…

Methodology · Statistics 2018-09-12 Jianqing Fan , Yuan Ke , Kaizheng Wang

In this work, we consider ranking problems among a finite set of candidates: for instance, selecting the top-$k$ items among a larger list of candidates or obtaining the full ranking of all items in the set. These problems are often…

Machine Learning · Statistics 2025-06-04 Ruiting Liang , Jake A. Soloff , Rina Foygel Barber , Rebecca Willett

It is known that the Thresholded Lasso (TL), SCAD or MCP correct intrinsic estimation bias of the Lasso. In this paper we propose an alternative method of improving the Lasso for predictive models with general convex loss functions which…

Statistics Theory · Mathematics 2021-01-26 Piotr Pokarowski , Wojciech Rejchel , Agnieszka Soltys , Michal Frej , Jan Mielniczuk

Model selection on validation data is an essential step in machine learning. While the mixing of data between training and validation is considered taboo, practitioners often violate it to increase performance. Here, we offer a simple,…

Machine Learning · Statistics 2018-02-19 Guy Tennenholtz , Tom Zahavy , Shie Mannor

Neuroimage analysis usually involves learning thousands or even millions of variables using only a limited number of samples. In this regard, sparse models, e.g. the lasso, are applied to select the optimal features and achieve high…

Machine Learning · Computer Science 2015-03-26 Bo Xin , Lingjing Hu , Yizhou Wang , Wen Gao

Model averaging techniques based on resampling methods (such as bootstrapping or subsampling) have been utilized across many areas of statistics, often with the explicit goal of promoting stability in the resulting output. We provide a…

Statistics Theory · Mathematics 2024-05-28 Jake A. Soloff , Rina Foygel Barber , Rebecca Willett

Stability is an important aspect of a classification procedure because unstable predictions can potentially reduce users' trust in a classification system and also harm the reproducibility of scientific conclusions. The major goal of our…

Machine Learning · Statistics 2017-01-23 Will Wei Sun , Guang Cheng , Yufeng Liu

To date, the instability of prognostic predictors in a sparse high dimensional model, which hinders their clinical adoption, has received little attention. Stable prediction is often overlooked in favour of performance. Yet, stability…

Machine Learning · Statistics 2016-09-29 Shivapratap Gopakumar , Truyen Tran , Dinh Phung , Svetha Venkatesh

Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm…

Methodology · Statistics 2022-11-14 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel , Agnieszka Sołtys

We consider the least-square linear regression problem with regularization by the l1-norm, a problem usually referred to as the Lasso. In this paper, we present a detailed asymptotic analysis of model consistency of the Lasso. For various…

Machine Learning · Computer Science 2008-12-18 Francis Bach

The advancement of deep learning technologies is bringing new models every day, motivating the study of scalable model selection. An ideal model selection scheme should minimally support two operations efficiently over a large pool of…

Machine Learning · Computer Science 2024-06-12 Wenxiao Wang , Weiming Zhuang , Lingjuan Lyu

Relevant methods of variable selection have been proposed in model-based clustering and classification. These methods are making use of backward or forward procedures to define the roles of the variables. Unfortunately, these stepwise…

Computation · Statistics 2017-05-03 Gilles Celeux , Cathy Maugis-Rabusseau , Mohammed Sedki

Stability Selection was recently introduced by Meinshausen and Buhlmann (2010) as a very general technique designed to improve the performance of a variable selection algorithm. It is based on aggregating the results of applying a selection…

Statistics Theory · Mathematics 2016-04-27 Rajen D. Shah , Richard J. Samworth

This study explores how different types of supervised models perform in the task of predicting and selecting relevant variables in high-dimensional contexts, especially when the data is very noisy. We analyzed three approaches: regularized…

Other Statistics · Statistics 2025-09-03 Luciano Ribeiro Galvão , Rafael de Andrade Mora

In this paper, we propose a novel variable selection approach in the framework of sparse high-dimensional GLARMA models. It consists in combining the estimation of the autoregressive moving average (ARMA) coefficients of these models with…

Statistics Theory · Mathematics 2019-10-14 Céline Lévy-Leduc , Sarah Ouadah , Laure Sansonnet

The Lasso is a prominent algorithm for variable selection. However, its instability in the presence of correlated variables in the high-dimensional setting is well-documented. Although previous research has attempted to address this issue…

Methodology · Statistics 2025-05-28 Mahdi Nouraie , Connor Smith , Samuel Muller