English
Related papers

Related papers: Large-scale Multi-objective Feature Selection: A M…

200 papers

In the field of big data analytics, the search for efficient subdata selection methods that enable robust statistical inferences with minimal computational resources is of high importance. A procedure prior to subdata selection could…

Methodology · Statistics 2024-11-12 Vasilis Chasiotis , Lin Wang , Dimitris Karlis

High-dimensional data remains a pervasive challenge in machine learning, often undermining model interpretability and computational efficiency. While Large Language Models (LLMs) have shown promise for dimensionality reduction through…

Machine Learning · Computer Science 2025-10-08 Mohamed Bal-Ghaoui , Fayssal Sabri

Analysis of high dimensional noisy data is of essence across a variety of research fields. Feature selection techniques are designed to find the relevant feature subset that can facilitate classification or pattern detection. Traditional…

Machine Learning · Computer Science 2014-04-14 Bo Wang , Anna Goldenberg

Feature selection is playing an increasingly significant role with respect to many computer vision applications spanning from object recognition to visual object tracking. However, most of the recent solutions in feature selection are not…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Giorgio Roffo , Simone Melzi , Umberto Castellani , Alessandro Vinciarelli

Feature selection is a crucial step in building machine learning models. This process is often achieved with accuracy as an objective, and can be cumbersome and computationally expensive for large-scale datasets. Several additional model…

Machine Learning · Computer Science 2024-03-15 Shubham Sharma , Sanghamitra Dutta , Emanuele Albini , Freddy Lecue , Daniele Magazzeni , Manuela Veloso

Feature selection plays a pivotal role in the data preprocessing and model-building pipeline, significantly enhancing model performance, interpretability, and resource efficiency across diverse domains. In population-based optimization…

Machine Learning · Computer Science 2024-08-20 Sevil Zanjani Miyandoab , Shahryar Rahnamayan , Azam Asilian Bidgoli , Sevda Ebrahimi , Masoud Makrehchi

The selection of features is an essential data preprocessing stage in data mining. The core principle of feature selection seems to be to pick a subset of possible features by excluding features with almost no predictive information as well…

Machine Learning · Computer Science 2020-08-11 Mehrdad Rostami , Kamal Berahmand , Saman Forouzandeh

In solving multi-modal, multi-objective optimization problems (MMOPs), the objective is not only to find a good representation of the Pareto-optimal front (PF) in the objective space but also to find all equivalent Pareto-optimal subsets…

Neural and Evolutionary Computing · Computer Science 2022-10-24 Tapabrata Ray , Mohammad Mohiuddin Mamun , Hemant Kumar Singh

This letter proposes a novel sparsity-aware adaptive filtering scheme and algorithms based on an alternating optimization strategy with shrinkage. The proposed scheme employs a two-stage structure that consists of an alternating…

Systems and Control · Computer Science 2023-07-19 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

Many-Objective Feature Selection (MOFS) approaches use four or more objectives to determine the relevance of a subset of features in a supervised learning task. As a consequence, MOFS typically returns a large set of non-dominated…

Machine Learning · Computer Science 2023-12-01 Uchechukwu F. Njoku , Alberto Abelló , Besim Bilalli , Gianluca Bontempi

We present a selective sampling method designed to accelerate the training of deep neural networks. To this end, we introduce a novel measurement, the minimal margin score (MMS), which measures the minimal amount of displacement an input…

Machine Learning · Computer Science 2019-11-19 Berry Weinstein , Shai Fine , Yacov Hel-Or

Feature selection is an important process in machine learning. It builds an interpretable and robust model by selecting the features that contribute the most to the prediction target. However, most mature feature selection algorithms,…

Machine Learning · Computer Science 2022-07-20 Zhifeng Qiu , Wanxin Zeng , Dahua Liao , Ning Gui

The goal of feature selection is to choose the optimal subset of features for a recognition task by evaluating the importance of each feature, thereby achieving effective dimensionality reduction. Currently, proposed feature selection…

Machine Learning · Computer Science 2024-02-27 Zhenxing Zhang , Jun Ge , Zheng Wei , Chunjie Zhou , Yilei Wang

Data-efficient learning aims to eliminate redundancy in large training datasets by training models on smaller subsets of the most informative examples. While data selection has been extensively explored for vision models and large language…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Nilay Naharas , Dang Nguyen , Nesihan Bulut , Mohammadhossein Bateni , Vahab Mirrokni , Baharan Mirzasoleiman

In order to improve the performance of Least Mean Square (LMS) based system identification of sparse systems, a new adaptive algorithm is proposed which utilizes the sparsity property of such systems. A general approximating approach on…

Information Theory · Computer Science 2015-06-15 Yuantao Gu , Jian Jin , Shunliang Mei

High-dimensional data is common in multiple areas, such as health care and genomics, where the number of features can be tens of thousands. In such scenarios, the large number of features often leads to inefficient learning. Constraint…

Machine Learning · Statistics 2023-06-13 Kartheek Bondugula , Santiago Mazuelas , Aritz Pérez

Effective features can improve the performance of a model, which can thus help us understand the characteristics and underlying structure of complex data. Previous feature selection methods usually cannot keep more local structure…

Machine Learning · Computer Science 2019-10-10 Xia Wu , Xueyuan Xu , Jianhong Liu , Hailing Wang , Bin Hu , Feiping Nie

Parent selection in evolutionary algorithms for multi-objective optimisation is usually performed by dominance mechanisms or indicator functions that prefer non-dominated points. We propose to refine the parent selection on evolutionary…

Neural and Evolutionary Computing · Computer Science 2018-09-05 Edgar Covantes Osuna , Wanru Gao , Frank Neumann , Dirk Sudholt

Feature selection (FS) remains essential for building accurate and interpretable detection models, particularly in high-dimensional malware datasets. Conventional FS methods such as Extra Trees, Variance Threshold, Tree-based models,…

Machine Learning · Computer Science 2026-02-11 Naveen Gill , Ajvad Haneef K , Madhu Kumar S D

Feature selection is essential for high-dimensional biomedical data, enabling stronger predictive performance, reduced computational cost, and improved interpretability in precision medicine applications. Existing approaches face notable…

Machine Learning · Computer Science 2026-01-07 Xiaoyan Sun , Qingyu Meng , Yalu Wen