English
Related papers

Related papers: A concise method for feature selection via normali…

200 papers

Feature selection and feature transformation, the two main ways to reduce dimensionality, are often presented separately. In this paper, a feature selection method is proposed by combining the popular transformation based dimensionality…

Machine Learning · Computer Science 2015-04-22 Hong Tao , Chenping Hou , Feiping Nie , Yuanyuan Jiao , Dongyun Yi

We study the problem of selecting limited features to observe such that models trained on them can perform well simultaneously across multiple subpopulations. This problem has applications in settings where collecting each feature is…

Machine Learning · Computer Science 2025-10-27 Maitreyi Swaroop , Tamar Krishnamurti , Bryan Wilder

Feature selection is a technique in statistical prediction modeling that identifies features in a record with a strong statistical connection to the target variable. Excluding features with a weak statistical connection to the target…

Quantum Physics · Physics 2025-11-07 Andrew Vlasic , Hunter Grant , Salvatore Certo

Feature selection is a critical step in data-driven applications, reducing input dimensionality to enhance learning accuracy, computational efficiency, and interpretability. Existing state-of-the-art methods often require post-selection…

Machine Learning · Computer Science 2025-08-18 Pedram Pad , Hadi Hammoud , Mohamad Dia , Nadim Maamari , L. Andrea Dunbar

Feature subset selection arises in many high-dimensional applications of statistics, such as compressed sensing and genomics. The $\ell_0$ penalty is ideal for this task, the caveat being it requires the NP-hard combinatorial evaluation of…

Machine Learning · Statistics 2017-06-26 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon Willard

Factorization Machines (FM), a general predictor that can efficiently model feature interactions in linear time, was primarily proposed for collaborative recommendation and have been broadly used for regression, classification and ranking…

Machine Learning · Computer Science 2021-08-18 Yu Geng , Liang Lan

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

Feature selection identifies subsets of informative features and reduces dimensions in the original feature space, helping provide insights into data generation or a variety of domain problems. Existing methods mainly depend on feature…

Machine Learning · Computer Science 2021-06-07 Xinxing Wu , Qiang Cheng

Machine learning applied to computer vision and signal processing is achieving results comparable to the human brain on specific tasks due to the great improvements brought by the deep neural networks (DNN). The majority of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 José Augusto Stuchi , Levy Boccato , Romis Attux

In data mining applications, feature selection is an essential process since it reduces a model's complexity. The cost of obtaining the feature values must be taken into consideration in many domains. In this paper, we study the…

Machine Learning · Computer Science 2013-06-04 Hong Zhao , Fan Min , William Zhu

Feature selection aims to identify the optimal feature subset for enhancing downstream models. Effective feature selection can remove redundant features, save computational resources, accelerate the model learning process, and improve the…

Machine Learning · Computer Science 2024-12-19 Nanxu Gong , Wangyang Ying , Dongjie Wang , Yanjie Fu

This work proposes a novel feature selection algorithm to classify Songs into different groups. Classification of musical content is often a non-trivial job and still relatively less explored area. The main idea conveyed in this article is…

Information Retrieval · Computer Science 2019-01-09 Anish Acharya

In order to allow machine learning algorithms to extract knowledge from raw data, these data must first be cleaned, transformed, and put into machine-appropriate form. These often very time-consuming phase is referred to as preprocessing.…

Machine Learning · Computer Science 2021-11-19 David Cemernek

When machine learning supports decision-making in safety-critical systems, it is important to verify and understand the reasons why a particular output is produced. Although feature importance calculation approaches assist in…

Machine Learning · Statistics 2020-09-14 Divish Rengasamy , Benjamin Rothwell , Grazziela Figueredo

Hyperspectral data consists of large number of features which require sophisticated analysis to be extracted. A popular approach to reduce computational cost, facilitate information representation and accelerate knowledge discovery is to…

Machine Learning · Computer Science 2015-09-29 Phool Preet , Sanjit Singh Batra , Jayadeva

Many computer vision and medical imaging problems are faced with learning from large-scale datasets, with millions of observations and features. In this paper we propose a novel efficient learning scheme that tightens a sparsity constraint…

Machine Learning · Statistics 2017-02-07 Adrian Barbu , Yiyuan She , Liangjing Ding , Gary Gramajo

We present a novel feature selection technique, Sparse Linear Centroid-Encoder (SLCE). The algorithm uses a linear transformation to reconstruct a point as its class centroid and, at the same time, uses the $\ell_1$-norm penalty to filter…

Machine Learning · Computer Science 2023-06-12 Tomojit Ghosh , Michael Kirby , Karim Karimov

We propose a Fourier-based approach for optimization of several clustering algorithms. Mathematically, clusters data can be described by a density function represented by the Dirac mixture distribution. The density function can be smoothed…

Machine Learning · Computer Science 2019-09-24 Soheil Mehrabkhani

Image retrieval based on deep convolutional features has demonstrated state-of-the-art performance in popular benchmarks. In this paper, we present a unified solution to address deep convolutional feature aggregation and image re-ranking by…

Information Retrieval · Computer Science 2018-10-10 Shanmin Pang , Jin Ma , Jianru Xue , Jihua Zhu , Vicente Ordonez

Nowadays, feature selection is frequently used in machine learning when there is a risk of performance degradation due to overfitting or when computational resources are limited. During the feature selection process, the subset of features…

Machine Learning · Computer Science 2023-01-02 Sergey A. Saltykov