English
Related papers

Related papers: Feature Selection Based on Unique Relevant Informa…

200 papers

The problem of feature selection has raised considerable interests in the past decade. Traditional unsupervised methods select the features which can faithfully preserve the intrinsic structures of data, where the intrinsic structures are…

Machine Learning · Computer Science 2015-04-06 Liang Du , Yi-Dong Shen

Feature selection methods are usually evaluated by wrapping specific classifiers and datasets in the evaluation process, resulting very often in unfair comparisons between methods. In this work, we develop a theoretical framework that…

Machine Learning · Statistics 2016-10-11 Cláudia Pascoal , M. Rosário Oliveira , António Pacheco , Rui Valadas

Feature selection plays a critical role in biomedical data mining, driven by increasing feature dimensionality in target problems and growing interest in advanced but computationally expensive methodologies able to model complex…

Data Structures and Algorithms · Computer Science 2018-04-04 Ryan J. Urbanowicz , Melissa Meeker , William LaCava , Randal S. Olson , Jason H. Moore

Feature selection is a widely used dimension reduction technique to select feature subsets because of its interpretability. Many methods have been proposed and achieved good results, in which the relationships between adjacent data points…

Machine Learning · Computer Science 2020-06-01 Yan Min , Mao Ye , Liang Tian , Yulin Jian , Ce Zhu , Shangming Yang

We investigate the problem of selecting features for datasets that can be naturally partitioned into subgroups (e.g., according to socio-demographic groups and age), each with its own dominant set of features. Within this subgroup-oriented…

Machine Learning · Computer Science 2024-12-10 Bar Genossar , Thinh On , Md. Mouinul Islam , Ben Eliav , Senjuti Basu Roy , Avigdor Gal

Mutual Information (MI) is often used for feature selection when developing classifier models. Estimating the MI for a subset of features is often intractable. We demonstrate, that under the assumptions of conditional independence, MI…

Machine Learning · Computer Science 2017-06-26 Hemanth Venkateswara , Prasanth Lade , Binbin Lin , Jieping Ye , Sethuraman Panchanathan

Deep models produce a number of features in each internal layer. A key problem in applications such as feature compression for remote inference is determining how important each feature is for the task(s) performed by the model. The problem…

Image and Video Processing · Electrical Eng. & Systems 2024-05-16 Saeed Ranjbar Alvar , Ivan V. Bajić

Feature selection is frequently used as a pre-processing step to machine learning. It is a process of choosing a subset of original features so that the feature space is optimally reduced according to a certain evaluation criterion. The…

Computer Vision and Pattern Recognition · Computer Science 2014-01-07 Vijendra Singh , Shivani Pathak

Mutual information has been successfully adopted in filter feature-selection methods to assess both the relevancy of a subset of features in predicting the target variable and the redundancy with respect to other variables. However,…

Machine Learning · Computer Science 2019-07-18 Mario Beraha , Alberto Maria Metelli , Matteo Papini , Andrea Tirinzoni , Marcello Restelli

Unsupervised feature selection aims to identify a compact subset of features that captures the intrinsic structure of data without supervised label. Most existing studies evaluate the performance of methods using the single-label dataset…

Machine Learning · Computer Science 2026-02-10 Gyu-Il Kim , Dae-Won Kim , Jaesung Lee

Many-Objective Feature Selection (MOFS) approaches use four or more objectives to determine the relevance of a subset of features in a supervised learning task. As a consequence, MOFS typically returns a large set of non-dominated…

Machine Learning · Computer Science 2023-12-01 Uchechukwu F. Njoku , Alberto Abelló , Besim Bilalli , Gianluca Bontempi

Although multi-view unsupervised feature selection (MUFS) is an effective technology for reducing dimensionality in machine learning, existing methods cannot directly deal with incomplete multi-view data where some samples are missing in…

Machine Learning · Computer Science 2024-01-22 Yanyong Huang , Zongxin Shen , Tianrui Li , Fengmao Lv

Feature selection (FS) is assumed to improve predictive performance and identify meaningful features in high-dimensional datasets. Surprisingly, small random subsets of features (0.02-1%) match or outperform the predictive performance of…

Machine Learning · Computer Science 2025-09-22 Bhavesh Neekhra , Debayan Gupta , Partha Pratim Chakrabarti

Feature selection is a critical step in the analysis of high-dimensional data, where the number of features often vastly exceeds the number of samples. Effective feature selection not only improves model performance and interpretability but…

Machine Learning · Computer Science 2025-01-27 Raquel Espinosa , Gracia Sánchez , José Palma , Fernando Jiménez

Feature selection has been proven a powerful preprocessing step for high-dimensional data analysis. However, most state-of-the-art methods tend to overlook the structural correlation information between pairwise samples, which may…

Machine Learning · Computer Science 2019-07-02 Lu Bai , Lixin Cui , Yue Wang , Philip S. Yu , Edwin R. Hancock

Unsupervised feature selection (UFS) is an important task in data engineering. However, most UFS methods construct models from a single perspective and often fail to simultaneously evaluate feature importance and preserve their inherent…

Machine Learning · Computer Science 2025-05-28 Jingjing Liu , Xiansen Ju , Xianchao Xiu , Wanquan Liu

Unsupervised feature selection (FS) is essential for high-dimensional learning tasks where labels are not available. It helps reduce noise, improve generalization, and enhance interpretability. However, most existing unsupervised FS methods…

Machine Learning · Computer Science 2025-11-13 Shira Lifshitz , Ofir Lindenbaum , Gal Mishne , Ron Meir , Hadas Benisty

Effective feature selection is essential for high-dimensional data analysis and machine learning. Unsupervised feature selection (UFS) aims to simultaneously cluster data and identify the most discriminative features. Most existing UFS…

Machine Learning · Statistics 2026-03-23 Feng Yu , MD Saifur Rahman Mazumder , Ying Su , Oscar Contreras Velasco

Mild Traumatic Brain Injury (mTBI) is a significant public health problem. The most troubling symptoms after mTBI are cognitive complaints. Studies show measurable differences between patients with mTBI and healthy controls with respect to…

Image and Video Processing · Electrical Eng. & Systems 2019-11-12 Tongda Xu , Xiyan Cai , Yao Wang , Xiuyuan Wang , Sohae Chung , Els Fieremans , Joseph Rath , Steven Flanagan , Yvonne W Lui

Along with the flourish of the information age, massive amounts of data are generated day by day. Due to the large-scale and high-dimensional characteristics of these data, it is often difficult to achieve better decision-making in…

Machine Learning · Computer Science 2023-04-04 Peican Zhu , Xin Hou , Keke Tang , Zhen Wang , Feiping Nie