English
Related papers

Related papers: BeSS: An R Package for Best Subset Selection in Li…

200 papers

We introduce c-lasso, a Python package that enables sparse and robust linear regression and classification with linear equality constraints. The underlying statistical forward model is assumed to be of the following form: \[ y = X \beta +…

Computation · Statistics 2020-11-03 Léo Simpson , Patrick L. Combettes , Christian L. Müller

Bayesian coresets have emerged as a promising approach for implementing scalable Bayesian inference. The Bayesian coreset problem involves selecting a (weighted) subset of the data samples, such that the posterior inference using the…

Machine Learning · Statistics 2021-03-01 Jacky Y. Zhang , Rajiv Khanna , Anastasios Kyrillidis , Oluwasanmi Koyejo

In exciting new work, Bertsimas et al. (2016) showed that the classical best subset selection problem in regression modeling can be formulated as a mixed integer optimization (MIO) problem. Using recent advances in MIO algorithms, they…

Methodology · Statistics 2017-08-01 Trevor Hastie , Robert Tibshirani , Ryan J. Tibshirani

This paper introduces two novel criteria: one for feature selection and another for feature elimination in the context of best subset selection, which is a benchmark problem in statistics and machine learning. From the perspective of…

Optimization and Control · Mathematics 2025-08-18 Zhihan Zhu , Yanhao Zhang , Yong Xia

Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a…

The sequential parameter optimization (SPOT) package for R is a toolbox for tuning and understanding simulation and optimization algorithms. Model-based investigations are common approaches in simulation and optimization. Sequential…

Neural and Evolutionary Computing · Computer Science 2010-06-25 Thomas Bartz-Beielstein

BRBVS is a publicly available \texttt{R} package on CRAN that implements the algorithm proposed in Petti et al.(2024a). The algorithm was developed as the first proposal of variable selection for the class of Bivariate Survival Copula…

Methodology · Statistics 2025-01-23 Danilo Petti , Marcella Niglio , Marialuisa Restaino

This paper considers a class of constrained stochastic composite optimization problems whose objective function is given by the summation of a differentiable (possibly nonconvex) component, together with a certain non-differentiable (but…

Optimization and Control · Mathematics 2013-09-06 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

Modern biomedical data mining requires feature selection methods that can (1) be applied to large scale feature spaces (e.g. `omics' data), (2) function in noisy problems, (3) detect complex patterns of association (e.g. gene-gene…

Machine Learning · Computer Science 2018-04-04 Ryan J. Urbanowicz , Randal S. Olson , Peter Schmitt , Melissa Meeker , Jason H. Moore

We propose an active set selection framework for Gaussian process classification for cases when the dataset is large enough to render its inference prohibitive. Our scheme consists of a two step alternating procedure of active set update…

Machine Learning · Statistics 2011-06-24 Ricardo Henao , Ole Winther

Feature selection is a crucial step in machine learning, especially for high-dimensional datasets, where irrelevant and redundant features can degrade model performance and increase computational costs. This paper proposes a novel…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Azam Asilian Bidgoli , Shahryar Rahnamayan

Feature selection plays a critical role in biomedical data mining, driven by increasing feature dimensionality in target problems and growing interest in advanced but computationally expensive methodologies able to model complex…

Data Structures and Algorithms · Computer Science 2018-04-04 Ryan J. Urbanowicz , Melissa Meeker , William LaCava , Randal S. Olson , Jason H. Moore

Modern datasets span billions of samples, making training on all available data infeasible. Selecting a high quality subset helps in reducing training costs and enhancing model quality. Submodularity, a discrete analogue of convexity, is…

Machine Learning · Computer Science 2025-04-04 Maximilian Böther , Abraham Sebastian , Pranjal Awasthi , Ana Klimovic , Srikumar Ramalingam

The bi-objective shortest-path (BOSP) problem seeks to find paths between start and target vertices of a graph while optimizing two conflicting objective functions. We consider the BOSP problem in the presence of correlated objectives. Such…

Artificial Intelligence · Computer Science 2025-09-26 Yaron Halle , Ariel Felner , Sven Koenig , Oren Salzman

Many partial identification problems can be characterized by the optimal value of a function over a set where both the function and set need to be estimated by empirical data. Despite some progress for convex problems, statistical inference…

Methodology · Statistics 2022-08-31 Matthew Tudball , Rachael Hughes , Kate Tilling , Jack Bowden , Qingyuan Zhao

Large language models (LLMs) have demonstrated remarkable capabilities in code generation and structured reasoning; however, their performance often degrades on complex tasks that require consistent multi-step planning. Recent work has…

Machine Learning · Computer Science 2025-08-11 Fei Xu Yu , Gina Adam , Nathaniel D. Bastian , Tian Lan

The sparse group lasso is a high-dimensional regression technique that is useful for problems whose predictors have a naturally grouped structure and where sparsity is encouraged at both the group and individual predictor level. In this…

Neural networks and deep learning are changing the way that artificial intelligence is being done. Efficiently choosing a suitable network architecture and fine-tune its hyper-parameters for a specific dataset is a time-consuming task given…

Machine Learning · Computer Science 2019-05-16 David Laredo , Yulin Qin , Oliver Schütze , Jian-Qiao Sun

The brms package allows R users to easily specify a wide range of Bayesian single-level and multilevel models, which are fitted with the probabilistic programming language Stan behind the scenes. Several response distributions are…

Computation · Statistics 2017-10-17 Paul-Christian Bürkner

The use of massive survival data has become common in survival analysis. In this study, a subsampling algorithm is proposed for the Cox proportional hazards model with time-dependent covariates when the sample is extraordinarily large but…

Computation · Statistics 2023-02-07 Nan Qiao , Wangcheng Li , Feng Xiao , Cunjie Lin , Yong Zhou