English
Related papers

Related papers: Performance analysis of unsupervised feature selec…

200 papers

In recent years, state-of-the-art methods for supervised learning have exploited increasingly gradient boosting techniques, with mainstream efficient implementations such as xgboost or lightgbm. One of the key points in generating…

Machine Learning · Computer Science 2018-12-12 David Saltiel , Eric Benhamou

Feature selection is a pattern recognition approach to choose important variables according to some criteria to distinguish or explain certain phenomena. There are many genomic and proteomic applications which rely on feature selection to…

Computer Vision and Pattern Recognition · Computer Science 2011-06-13 Fabricio Martins Lopes , David Correa Martins-Jr , Roberto M. Cesar-Jr

Deep Recommender Systems (DRS) are increasingly dependent on a large number of feature fields for more precise recommendations. Effective feature selection methods are consequently becoming critical for further enhancing the accuracy and…

Information Retrieval · Computer Science 2024-06-21 Pengyue Jia , Yejing Wang , Zhaocheng Du , Xiangyu Zhao , Yichao Wang , Bo Chen , Wanyu Wang , Huifeng Guo , Ruiming Tang

By Emerging huge databases and the need to efficient learning algorithms on these datasets, new problems have appeared and some methods have been proposed to solve these problems by selecting efficient features. Feature selection is a…

Computer Vision and Pattern Recognition · Computer Science 2016-01-21 Mitra Montazeri , Mahdieh Soleymani Baghshah , Aliakbar Niknafs

Classic feature selection techniques remove those features that are either irrelevant or redundant, achieving a subset of relevant features that help to provide a better knowledge extraction. This allows the creation of compact models that…

Machine Learning · Computer Science 2020-12-16 Brais Cancela , Verónica Bolón-Canedo , Amparo Alonso-Betanzos , João Gama

Feature selection is essential for effective visual recognition. We propose an efficient joint classifier learning and feature selection method that discovers sparse, compact representations of input features from a vast sea of candidates,…

Computer Vision and Pattern Recognition · Computer Science 2015-12-03 Marius Leordeanu , Alexandra Radu , Shumeet Baluja , Rahul Sukthankar

For classification problems, feature extraction is a crucial process which aims to find a suitable data representation that increases the performance of the machine learning algorithm. According to the curse of dimensionality theorem, the…

Machine Learning · Computer Science 2010-10-12 Ilknur Icke , Andrew Rosenberg

The proposed feature selection method builds a histogram of the most stable features from random subsets of a training set and ranks the features based on a classifier based cross-validation. This approach reduces the instability of…

Artificial Intelligence · Computer Science 2012-02-07 Alex Pappachen James , Akshay Maan

Feature selection that selects an informative subset of variables from data not only enhances the model interpretability and performance but also alleviates the resource demands. Recently, there has been growing attention on feature…

Neural and Evolutionary Computing · Computer Science 2023-03-15 Zahra Atashgahi , Xuhao Zhang , Neil Kichler , Shiwei Liu , Lu Yin , Mykola Pechenizkiy , Raymond Veldhuis , Decebal Constantin Mocanu

In the field of data mining, how to deal with high-dimensional data is an inevitable problem. Unsupervised feature selection has attracted more and more attention because it does not rely on labels. The performance of spectral-based…

Machine Learning · Computer Science 2021-01-01 Zhengxin Li , Feiping Nie , Jintang Bian , Xuelong Li

Feature selection is a dimensionality reduction technique that selects a subset of representative features from high dimensional data by eliminating irrelevant and redundant features. Recently, feature selection combined with sparse…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Siwei Feng , Marco F. Duarte

By removing irrelevant and redundant features, feature selection aims to find a good representation of the original features. With the prevalence of unlabeled data, unsupervised feature selection has been proven effective in alleviating the…

Machine Learning · Computer Science 2024-03-25 Ziyuan Lin , Deanna Needell

The redundant features existing in high dimensional datasets always affect the performance of learning and mining algorithms. How to detect and remove them is an important research topic in machine learning and data mining research. In this…

Machine Learning · Computer Science 2017-07-04 Shuchu Han , Hao Huang , Hong Qin

The selection of features is an essential data preprocessing stage in data mining. The core principle of feature selection seems to be to pick a subset of possible features by excluding features with almost no predictive information as well…

Machine Learning · Computer Science 2020-08-11 Mehrdad Rostami , Kamal Berahmand , Saman Forouzandeh

In high-dimensional regression, feature selection methods, such as sequential feature selection (SeqFS), are commonly used to identify relevant features. When data is limited, domain adaptation (DA) becomes crucial for transferring…

Machine Learning · Statistics 2025-01-20 Duong Tan Loc , Nguyen Thang Loi , Vo Nguyen Le Duy

High-dimensional data is commonly encountered in numerous data analysis tasks. Feature selection techniques aim to identify the most representative features from the original high-dimensional data. Due to the absence of class label…

Machine Learning · Computer Science 2024-10-29 Yunhui Liang , Jianwen Gan , Yan Chen , Peng Zhou , Liang Du

In this paper, we study the application of sparse principal component analysis (PCA) to clustering and feature selection problems. Sparse PCA seeks sparse factors, or linear combinations of the data variables, explaining a maximum amount of…

Artificial Intelligence · Computer Science 2008-10-08 Ronny Luss , Alexandre d'Aspremont

Factor-based forecasting using Principal Component Analysis (PCA) is an effective machine learning tool for dimension reduction with many applications in statistics, economics, and finance. This paper introduces a Supervised Screening and…

Econometrics · Economics 2025-02-24 Sihan Tu , Zhaoxing Gao

Recent discussion of the success of feature selection methods has argued that focusing on a relatively small number of features has been counterproductive. Instead, it is suggested, the number of significant features can be in the thousands…

Statistics Theory · Mathematics 2014-07-10 Peter Hall , Jiashun Jin , Hugh Miller

In this paper, we present a new method for few-sample supervised feature selection (FS). Our method first learns the manifold of the feature space of each class using kernels capturing multi-feature associations. Then, based on Riemannian…

Machine Learning · Statistics 2022-07-19 David Cohen , Tal Shnitzer , Yuval Kluger , Ronen Talmon