English
Related papers

Related papers: A Contrast Based Feature Selection Algorithm for H…

200 papers

We propose a filtering feature selection framework that considers subsets of features as paths in a graph, where a node is a feature and an edge indicates pairwise (customizable) relations among features, dealing with relevance and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Giorgio Roffo , Simone Melzi , Umberto Castellani , Alessandro Vinciarelli , Marco Cristani

In this paper, we study the problem of balancing effectiveness and efficiency in automated feature selection. Feature selection is a fundamental intelligence for machine learning and predictive analysis. After exploring many feature…

Machine Learning · Computer Science 2020-09-17 Wei Fan , Kunpeng Liu , Hao Liu , Pengyang Wang , Yong Ge , Yanjie Fu

In a typical supervised machine learning setting, the predictions on all test instances are based on a common subset of features discovered during model training. However, using a different subset of features that is most informative for…

Machine Learning · Computer Science 2021-06-10 Yasitha Warahena Liyanage , Daphney-Stavroula Zois , Charalampos Chelmis

Feature selection is popular for obtaining small, interpretable, yet highly accurate prediction models. Conventional feature-selection methods typically yield one feature set only, which might not suffice in some scenarios. For example,…

Machine Learning · Computer Science 2025-02-07 Jakob Bach

Distributed and federated learning are important tools for high-dimensional classification of large datasets. To reduce computational costs and overcome the curse of dimensionality, feature screening plays a pivotal role in eliminating…

Machine Learning · Statistics 2025-06-03 Qi Qin , Erbo Li , Xingxiang Li , Yifan Sun , Wu Wang , Chen Xu

For classification problems, feature extraction is a crucial process which aims to find a suitable data representation that increases the performance of the machine learning algorithm. According to the curse of dimensionality theorem, the…

Machine Learning · Computer Science 2010-10-12 Ilknur Icke , Andrew Rosenberg

Online selection of dynamic features has attracted intensive interest in recent years. However, existing online feature selection methods evaluate features individually and ignore the underlying structure of feature stream. For instance, in…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Jing Wang , Meng Wang , Peipei Li , Luoqi Liu , Zhongqiu Zhao , Xuegang Hu , Xindong Wu

Feature selection is an important process in machine learning. It builds an interpretable and robust model by selecting the features that contribute the most to the prediction target. However, most mature feature selection algorithms,…

Machine Learning · Computer Science 2022-07-20 Zhifeng Qiu , Wanxin Zeng , Dahua Liao , Ning Gui

A supervised feature selection method selects an appropriate but concise set of features to differentiate classes, which is highly expensive for large-scale datasets. Therefore, feature selection should aim at both minimizing the number of…

Machine Learning · Computer Science 2024-02-21 Sevil Zanjani Miyandoab , Shahryar Rahnamayan , Azam Asilian Bidgoli

With the decreasing cost of data collection, the space of variables or features that can be used to characterize a particular predictor of interest continues to grow exponentially. Therefore, identifying the most characterizing features…

Machine Learning · Computer Science 2021-01-26 Sali Rasoul , Sodiq Adewole , Alphonse Akakpo

Feature selection is an important preprocessing step in machine learning and data mining. In real-world applications, costs, including money, time and other resources, are required to acquire the features. In some cases, there is a test…

Artificial Intelligence · Computer Science 2013-05-22 Fan Min , Qinghua Hu , William Zhu

Feature selection is an important part of building a machine learning model. By eliminating redundant or misleading features from data, the machine learning model can achieve better performance while reducing the demand on com-puting…

Machine Learning · Computer Science 2021-06-11 Song Tan , Xia He

Unlike unsupervised approaches such as autoencoders that learn to reconstruct their inputs, this paper introduces an alternative approach to unsupervised feature learning called divergent discriminative feature accumulation (DDFA) that…

Neural and Evolutionary Computing · Computer Science 2014-06-11 Paul A. Szerlip , Gregory Morse , Justin K. Pugh , Kenneth O. Stanley

Feature Learning aims to extract relevant information contained in data sets in an automated fashion. It is driving force behind the current deep learning trend, a set of methods that have had widespread empirical success. What is lacking…

Machine Learning · Statistics 2015-04-02 Brendan van Rooyen , Robert C. Williamson

Dynamic feature selection (DFS) addresses budget constraints in decision-making by sequentially acquiring features for each instance, making it appealing for resource-limited scenarios. However, existing DFS methods require models…

Machine Learning · Computer Science 2026-02-19 Javier Fumanal-Idocin , Raquel Fernandez-Peralta , Javier Andreu-Perez

Hierarchical classification is a crucial task in many applications, where objects are organized into multiple levels of categories. However, conventional classification approaches often neglect inherent inter-class relationships at…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Julius Ott , Nastassia Vysotskaya , Huawei Sun , Lorenzo Servadei , Robert Wille

Feature selection is a crucial step in building machine learning models. This process is often achieved with accuracy as an objective, and can be cumbersome and computationally expensive for large-scale datasets. Several additional model…

Machine Learning · Computer Science 2024-03-15 Shubham Sharma , Sanghamitra Dutta , Emanuele Albini , Freddy Lecue , Daniele Magazzeni , Manuela Veloso

Feature selection has evolved to be an important step in several machine learning paradigms. In domains like bio-informatics and text classification which involve data of high dimensions, feature selection can help in drastically reducing…

Machine Learning · Computer Science 2019-04-23 Nand Sharma , Prathamesh Verlekar , Rehab Ashary , Sui Zhiquan

Feature selection and reducing the dimensionality of data is an essential step in data analysis. In this work, we propose a new criterion for feature selection that is formulated as conditional information between features given the labeled…

Machine Learning · Statistics 2019-05-20 Salimeh Yasaei Sekeh , Alfred O. Hero

Many real-world machine learning applications are characterized by a huge number of features, leading to computational and memory issues, as well as the risk of overfitting. Ideally, only relevant and non-redundant features should be…

Machine Learning · Computer Science 2023-06-21 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli