English
Related papers

Related papers: Unsupervised Feature Selection via Multi-step Mark…

200 papers

Feature selection prepares the AI-readiness of data by eliminating redundant features. Prior research falls into two primary categories: i) Supervised Feature Selection, which identifies the optimal feature subset based on their relevance…

Machine Learning · Computer Science 2024-03-08 Xinyuan Wang , Dongjie Wang , Wangyang Ying , Rui Xie , Haifeng Chen , Yanjie Fu

In this paper, we propose a model-free feature selection method for ultra-high dimensional data with mass features. This is a two phases procedure that we propose to use the fused Kolmogorov filter with the random forest based RFE to remove…

Methodology · Statistics 2023-02-16 Siwei Xia , Yuehan Yang

Feature selection is a combinatorial optimization problem that is NP-hard. Conventional approaches often employ heuristic or greedy strategies, which are prone to premature convergence and may fail to capture subtle yet informative…

Machine Learning · Computer Science 2025-10-22 Yusi Fan , Tian Wang , Zhiying Yan , Chang Liu , Qiong Zhou , Qi Lu , Zhehao Guo , Ziqi Deng , Wenyu Zhu , Ruochi Zhang , Fengfeng Zhou

Feature selection is a critical step in high-dimensional classification tasks, particularly under challenging conditions of double imbalance, namely settings characterized by both class imbalance in the response variable and dimensional…

Methodology · Statistics 2025-06-13 Fabio Demaria

The goal of Feature Selection - comprising filter, wrapper, and embedded approaches - is to find the optimal feature subset for designated downstream tasks. Nevertheless, current feature selection methods are limited by: 1) the selection…

Machine Learning · Computer Science 2023-09-18 Meng Xiao , Dongjie Wang , Min Wu , Pengfei Wang , Yuanchun Zhou , Yanjie Fu

Nowadays, feature selection is frequently used in machine learning when there is a risk of performance degradation due to overfitting or when computational resources are limited. During the feature selection process, the subset of features…

Machine Learning · Computer Science 2023-01-02 Sergey A. Saltykov

Modeling the evolution of high-dimensional systems from limited snapshot observations at irregular time points poses a significant challenge in quantitative biology and related fields. Traditional approaches often rely on dimensionality…

Machine Learning · Computer Science 2025-08-07 Justin Lee , Behnaz Moradijamei , Heman Shakeri

Feature selection is a technique to screen out less important features. Many existing supervised feature selection algorithms use redundancy and relevancy as the main criteria to select features. However, feature interaction, potentially a…

Machine Learning · Statistics 2015-06-11 Wittawat Jitkrittum , Hirotaka Hachiya , Masashi Sugiyama

Traditional nonnegative matrix factorization (NMF) learns a new feature representation on the whole data space, which means treating all features equally. However, a subspace is often sufficient for accurate representation in practical…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Junhang Li , Jiao Wei , Can Tong , Tingting Shen , Yuchen Liu , Chen Li , Shouliang Qi , Yudong Yao , Yueyang Teng

Feature selection (FS) is an important research topic in machine learning. Usually, FS is modelled as a+ bi-objective optimization problem whose objectives are: 1) classification accuracy; 2) number of features. One of the main issues in…

Artificial Intelligence · Computer Science 2021-04-21 Yu Xue , Yihang Tang , Xin Xu , Jiayu Liang , Ferrante Neri

Machine Learning (ML) techniques are becoming an invaluable support for network intrusion detection, especially in revealing anomalous flows, which often hide cyber-threats. Typically, ML algorithms are exploited to classify/recognize data…

Cryptography and Security · Computer Science 2021-04-13 Mario Di Mauro , Giovanni Galatro , Giancarlo Fortino , Antonio Liotta

Missing data are a concern in many real world data sets and imputation methods are often needed to estimate the values of missing data, but data sets with excessive missingness and high dimensionality challenge most approaches to…

Machine Learning · Statistics 2021-04-22 Andrew J. Becker , James P. Bagrow

Feature selection, as a vital dimension reduction technique, reduces data dimension by identifying an essential subset of input features, which can facilitate interpretable insights into learning and inference processes. Algorithmic…

Machine Learning · Computer Science 2022-01-06 Xinxing Wu , Qiang Cheng

Many novel unsupervised feature selection methods are proposed each year, yet their empirical evaluation is limited to supervised and unsupervised evaluation metrics computed on selected datasets, along with comparisons to existing methods.…

Machine Learning · Computer Science 2026-05-25 Muhammad Rajabinasab , Michael E. Houle , Oussama Chelly , Arthur Zimek

Feature selection is critical in machine learning to reduce dimensionality and improve model accuracy and efficiency. The exponential growth in feature space dimensionality for modern datasets directly results in ambiguous samples and…

Quantum Physics · Physics 2023-11-30 Haiyan Wang

Feature selection aims to identify the most pattern-discriminative feature subset. In prior literature, filter (e.g., backward elimination) and embedded (e.g., Lasso) methods have hyperparameters (e.g., top-K, score thresholding) and tie to…

Machine Learning · Computer Science 2024-03-07 Wangyang Ying , Dongjie Wang , Haifeng Chen , Yanjie Fu

Motivated by the problem of identifying correlations between genes or features of two related biological systems, we propose a model of \emph{feature selection} in which only a subset of the predictors $X_t$ are dependent on the…

Applications · Statistics 2011-11-29 Charles Zheng , Scott Schwartz , Robert Chapkin , Raymond Carroll , Ivan Ivanov

Feature selection has been proven a powerful preprocessing step for high-dimensional data analysis. However, most state-of-the-art methods tend to overlook the structural correlation information between pairwise samples, which may…

Machine Learning · Computer Science 2019-07-02 Lu Bai , Lixin Cui , Yue Wang , Philip S. Yu , Edwin R. Hancock

Multimodal evidence is critical in computational pathology: gigapixel whole slide images capture tumor morphology, while patient-level clinical descriptors preserve complementary context for prognosis. Integrating such heterogeneous signals…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Chengying She , Chengwei Chen , Xinran Zhang , Ben Wang , Lizhuang Liu , Chengwei Shao , Yun Bian

This paper introduces a novel graph-based filter method for automatic feature selection (abbreviated as GB-AFS) for multi-class classification tasks. The method determines the minimum combination of features required to sustain prediction…

Machine Learning · Computer Science 2023-09-06 David Levin , Gonen Singer