English
Related papers

Related papers: EasyFS: an Efficient Model-free Feature Selection …

200 papers

Feature selection helps reduce data acquisition costs in ML, but the standard approach is to train models with static feature subsets. Here, we consider the dynamic feature selection (DFS) problem where a model sequentially queries features…

Machine Learning · Computer Science 2023-06-09 Ian Covert , Wei Qiu , Mingyu Lu , Nayoon Kim , Nathan White , Su-In Lee

The growth of data today poses a challenge in management and inference. While feature extraction methods are capable of reducing the size of the data for inference, they do not help in minimizing the cost of data storage. On the other hand,…

Machine Learning · Computer Science 2022-03-04 Thu Nguyen , Thanh Nhan Phan , Van Nhuong Nguyen , Thanh Binh Nguyen , Pål Halvorsen , Michael Riegler

Recommender systems leverage extensive user interaction data to model preferences; however, directly modeling these data may introduce biases that disproportionately favor popular items. In this paper, we demonstrate that popularity bias…

Information Retrieval · Computer Science 2025-04-21 Jiahao Liu , Dongsheng Li , Hansu Gu , Peng Zhang , Tun Lu , Li Shang , Ning Gu

In this paper, a new feature selection algorithm, called SFE (Simple, Fast, and Efficient), is proposed for high-dimensional datasets. The SFE algorithm performs its search process using a search agent and two operators: non-selection and…

Nowadays, feature selection is frequently used in machine learning when there is a risk of performance degradation due to overfitting or when computational resources are limited. During the feature selection process, the subset of features…

Machine Learning · Computer Science 2023-01-02 Sergey A. Saltykov

Unsupervised feature selection (FS) is essential for high-dimensional learning tasks where labels are not available. It helps reduce noise, improve generalization, and enhance interpretability. However, most existing unsupervised FS methods…

Machine Learning · Computer Science 2025-11-13 Shira Lifshitz , Ofir Lindenbaum , Gal Mishne , Ron Meir , Hadas Benisty

In this article, we present the elitist particle filter based on evolutionary strategies (EPFES) as an efficient approach for nonlinear system identification. The EPFES is derived from the frequently-employed state-space model, where the…

Machine Learning · Statistics 2016-05-26 Christian Huemmer , Christian Hofmann , Roland Maas , Walter Kellermann

Recently, evolutionary multitasking (EMT) has been successfully used in the field of high-dimensional classification. However, the generation of multiple tasks in the existing EMT-based feature selection (FS) methods is relatively simple,…

Neural and Evolutionary Computing · Computer Science 2022-12-20 Lingjie Li , Manlin Xuan , Qiuzhen Lin , Min Jiang , Zhong Ming , Kay Chen Tan

Unsupervised feature extraction algorithms form one of the most important building blocks in machine learning systems. These algorithms are often adapted to the event-based domain to perform online learning in neuromorphic hardware.…

Neural and Evolutionary Computing · Computer Science 2019-07-31 Saeed Afshar , Ying Xu , Jonathan Tapson , André van Schaik , Gregory Cohen

Multi-view unsupervised feature selection (MUFS), which selects informative features from multi-view unlabeled data, has attracted increasing research interest in recent years. Although great efforts have been devoted to MUFS, several…

Machine Learning · Computer Science 2025-11-12 Minghui Lu , Yanyong Huang , Minbo Ma , Jinyuan Chang , Dongjie Wang , Xiuwen Yi , Tianrui Li

We propose a filtering feature selection framework that considers subsets of features as paths in a graph, where a node is a feature and an edge indicates pairwise (customizable) relations among features, dealing with relevance and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Giorgio Roffo , Simone Melzi , Umberto Castellani , Alessandro Vinciarelli , Marco Cristani

This paper proposes a novel model-free screening procedure for ultrahigh dimensional data analysis. By utilizing slicing technique which has been successfully ap- plied to continuous variables, we construct a new index called the fused…

Methodology · Statistics 2016-12-28 Yan Xiao-Dong , Xie Jin-Han , Ding Xian-Wen , Wang Zhi-Qiang , Tang Nian-Sheng

Large-scale online marketplaces and recommender systems serve as critical technological support for e-commerce development. In industrial recommender systems, features play vital roles as they carry information for downstream models.…

Information Retrieval · Computer Science 2026-02-24 Xianquan Wang , Zhaocheng Du , Jieming Zhu , Qinglin Jia , Zhenhua Dong , Kai Zhang

A key challenge in the continual learning setting is to efficiently learn a sequence of tasks without forgetting how to perform previously learned tasks. Many existing approaches to this problem work by either retraining the model on…

Machine Learning · Computer Science 2024-01-12 Weijieying Ren , Vasant G Honavar

In recent years, deep convolutional neural networks (CNN) have significantly advanced face detection. In particular, lightweight CNNbased architectures have achieved great success due to their lowcomplexity structure facilitating real-time…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Guangtao Wang , Jun Li , Zhijian Wu , Jianhua Xu , Jifeng Shen , Wankou Yang

To deal with high-dimensional unlabeled datasets in many areas, principal component analysis (PCA) has become a rising technique for unsupervised feature selection (UFS). However, most existing PCA-based methods only consider the structure…

Optimization and Control · Mathematics 2025-08-15 Xianchao Xiu , Chenyi Huang , Pan Shang , Wanquan Liu

Major complications arise from the recent increase in the amount of high-dimensional data, including high computational costs and memory requirements. Feature selection, which identifies the most relevant and informative attributes of a…

This paper introduces a new technique to measure the feature dependency of neural network models. The motivation is to better understand a model by querying whether it is using information from human-understandable features, e.g.,…

Machine Learning · Computer Science 2024-10-10 Yinzhu Jin , Matthew B. Dwyer , P. Thomas Fletcher

Internal features from large-scale pre-trained diffusion models have recently been established as powerful semantic descriptors for a wide range of downstream tasks. Works that use these features generally need to add noise to images before…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Nick Stracke , Stefan Andreas Baumann , Kolja Bauer , Frank Fundel , Björn Ommer

This paper discusses predictive inference and feature selection for generalized linear models with scarce but high-dimensional data. We argue that in many cases one can benefit from a decision theoretically justified two-stage approach:…

Machine Learning · Statistics 2020-11-09 Juho Piironen , Markus Paasiniemi , Aki Vehtari