English
Related papers

Related papers: Fast Feature Selection with Fairness Constraints

200 papers

The goal of Feature Selection - comprising filter, wrapper, and embedded approaches - is to find the optimal feature subset for designated downstream tasks. Nevertheless, current feature selection methods are limited by: 1) the selection…

Machine Learning · Computer Science 2023-09-18 Meng Xiao , Dongjie Wang , Min Wu , Pengfei Wang , Yuanchun Zhou , Yanjie Fu

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

Machine Learning · Computer Science 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

Feature selection is a prevalent data preprocessing paradigm for various learning tasks. Due to the expensive cost of acquiring supervision information, unsupervised feature selection sparks great interests recently. However, existing…

Machine Learning · Computer Science 2021-06-07 Xiaoying Xing , Hongfu Liu , Chen Chen , Jundong Li

Streaming submodular maximization is a natural model for the task of selecting a representative subset from a large-scale dataset. If datapoints have sensitive attributes such as gender or race, it becomes important to enforce fairness to…

Machine Learning · Computer Science 2025-11-25 Marwa El Halabi , Federico Fusco , Ashkan Norouzi-Fard , Jakab Tardos , Jakub Tarnawski

Constrained submodular maximization problems encompass a wide variety of applications, including personalized recommendation, team formation, and revenue maximization via viral marketing. The massive instances occurring in modern day…

Data Structures and Algorithms · Computer Science 2024-02-20 Georgios Amanatidis , Federico Fusco , Philip Lazos , Stefano Leonardi , Rebecca Reiffenhäuser

Feature selection for predictive analytics is the problem of identifying a minimal-size subset of features that is maximally predictive of an outcome of interest. To apply to molecular data, feature selection algorithms need to be scalable…

Machine Learning · Statistics 2020-04-02 Michail Tsagris , Zacharias Papadovasilakis , Kleanthi Lakiotaki , Ioannis Tsamardinos

In this paper, we consider the problem of accelerating the numerical simulation of time dependent problems by time domain decomposition. The available algorithms enabling such decompositions present severe efficiency limitations and are an…

Numerical Analysis · Mathematics 2020-03-27 Y. Maday , O. Mula

Solving stochastic optimization problems under partial observability, where one needs to adaptively make decisions with uncertain outcomes, is a fundamental but notoriously difficult challenge. In this paper, we introduce the concept of…

Machine Learning · Computer Science 2017-12-07 Daniel Golovin , Andreas Krause

In dictionary selection, several atoms are selected from finite candidates that successfully approximate given data points in the sparse representation. We propose a novel efficient greedy algorithm for dictionary selection. Not only does…

Machine Learning · Computer Science 2018-09-10 Kaito Fujii , Tasuku Soma

In an ordinary feature selection procedure, a set of important features is obtained by solving an optimization problem such as the Lasso regression problem, and we expect that the obtained features explain the data well. In this study,…

Machine Learning · Statistics 2018-10-16 Satoshi Hara , Takanori Maehara

In this paper, we study the classic submodular maximization problem subject to a group equality constraint under both non-adaptive and adaptive settings. It has been shown that the utility function of many machine learning applications,…

Machine Learning · Computer Science 2023-08-30 Shaojie Tang , Jing Yuan

We introduce the model selection problem in pure exploration linear bandits, where the learner needs to adapt to the instance-dependent complexity measure of the smallest hypothesis class containing the true model. We design algorithms in…

Machine Learning · Statistics 2022-03-18 Yinglun Zhu , Julian Katz-Samuels , Robert Nowak

We study the problem of selecting most informative subset of a large observation set to enable accurate estimation of unknown parameters. This problem arises in a variety of settings in machine learning and signal processing including…

Signal Processing · Electrical Eng. & Systems 2019-05-27 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu

A variety of large-scale machine learning problems can be cast as instances of constrained submodular maximization. Existing approaches for distributed submodular maximization have a critical drawback: The capacity - number of instances…

Machine Learning · Statistics 2016-06-01 Mario Lucic , Olivier Bachem , Morteza Zadimoghaddam , Andreas Krause

Sparse estimation methods capable of tolerating outliers have been broadly investigated in the last decade. We contribute to this research considering high-dimensional regression problems contaminated by multiple mean-shift outliers which…

Methodology · Statistics 2025-10-21 Luca Insolia , Ana Kenney , Francesca Chiaromonte , Giovanni Felici

Submodular maximization is a general optimization problem with a wide range of applications in machine learning (e.g., active learning, clustering, and feature selection). In large-scale optimization, the parallel running time of an…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

Recent progress in deep learning has been driven by increasingly larger models. However, their computational and energy demands have grown proportionally, creating significant barriers to their deployment and to a wider adoption of deep…

Machine Learning · Computer Science 2025-09-16 Pedro Savarese

In this paper, we present a new adaptive feature scaling scheme for ultrahigh-dimensional feature selection on Big Data. To solve this problem effectively, we first reformulate it as a convex semi-infinite programming (SIP) problem and then…

Machine Learning · Computer Science 2019-12-17 Mingkui Tan , Ivor W. Tsang , Li Wang

Motivated by modern applications such as computerized adaptive testing, sequential rank aggregation, and heterogeneous data source selection, we study the problem of active sequential estimation, which involves adaptively selecting…

Statistics Theory · Mathematics 2024-02-14 Xiaoou Li , Hongru Zhao

Feature selection is a problem of finding efficient features among all features in which the final feature set can improve accuracy and reduce complexity. In feature selection algorithms search strategies are key aspects. Since feature…

Machine Learning · Computer Science 2016-01-27 Mohadeseh Montazeri , Hamid Reza Naji , Mitra Montazeri , Ahmad Faraahi