English
Related papers

Related papers: Relevant based structure learning for feature sele…

200 papers

In the most intrusion detection systems (IDS), a system tries to learn characteristics of different type of attacks by analyzing packets that sent or received in network. These packets have a lot of features. But not all of them is required…

Cryptography and Security · Computer Science 2013-05-13 Shafigh Parsazad , Ehsan Saboori , Amin Allahyar

Classic feature selection techniques remove those features that are either irrelevant or redundant, achieving a subset of relevant features that help to provide a better knowledge extraction. This allows the creation of compact models that…

Machine Learning · Computer Science 2020-12-16 Brais Cancela , Verónica Bolón-Canedo , Amparo Alonso-Betanzos , João Gama

Feature selection is a critical step in the analysis of high-dimensional data, where the number of features often vastly exceeds the number of samples. Effective feature selection not only improves model performance and interpretability but…

Machine Learning · Computer Science 2025-01-27 Raquel Espinosa , Gracia Sánchez , José Palma , Fernando Jiménez

Feature selection is an essential process in machine learning, especially when dealing with high-dimensional datasets. It helps reduce the complexity of machine learning models, improve performance, mitigate overfitting, and decrease…

Machine Learning · Computer Science 2024-10-10 Egor Kraev , Baran Koseoglu , Luca Traverso , Mohammed Topiwalla

No matter the expressive power and sophistication of supervised learning algorithms, their effectiveness is restricted by the features describing the data. This is not a new insight in ML and many methods for feature selection,…

Machine Learning · Computer Science 2014-07-18 Albrecht Zimmermann

In this paper, we introduce a novel unsupervised, graph-based filter feature selection technique which exploits the power of topologically constrained network representations. We model dependency structures among features using a family of…

Machine Learning · Computer Science 2023-07-04 Antonio Briola , Tomaso Aste

This document introduces basics in data preparation, feature selection and learning basics for high energy physics tasks. The emphasis is on feature selection by principal component analysis, information gain and significance measures for…

Data Analysis, Statistics and Probability · Physics 2008-03-18 Anselm Vossen

Sparse Bayesian learning is a state-of-the-art supervised learning algorithm that can choose a subset of relevant samples from the input data and make reliable probabilistic predictions. However, in the presence of high-dimensional data…

Machine Learning · Computer Science 2020-01-10 Bingbing Jiang , Chang Li , Maarten de Rijke , Xin Yao , Huanhuan Chen

Dealing with datasets of very high dimension is a major challenge in machine learning. In this paper, we consider the problem of feature selection in applications where the memory is not large enough to contain all features. In this…

Machine Learning · Statistics 2017-09-07 Antonio Sutera , Célia Châtel , Gilles Louppe , Louis Wehenkel , Pierre Geurts

By Emerging huge databases and the need to efficient learning algorithms on these datasets, new problems have appeared and some methods have been proposed to solve these problems by selecting efficient features. Feature selection is a…

Computer Vision and Pattern Recognition · Computer Science 2016-01-21 Mitra Montazeri , Mahdieh Soleymani Baghshah , Aliakbar Niknafs

The goal of supervised feature selection is to find a subset of input features that are responsible for predicting output values. The least absolute shrinkage and selection operator (Lasso) allows computationally efficient feature selection…

Machine Learning · Statistics 2019-01-07 Makoto Yamada , Wittawat Jitkrittum , Leonid Sigal , Eric P. Xing , Masashi Sugiyama

This paper proposes inverse feature learning as a novel supervised feature learning technique that learns a set of high-level features for classification based on an error representation approach. The key contribution of this method is to…

Machine Learning · Computer Science 2020-03-10 Behzad Ghazanfari , Fatemeh Afghah , MohammadTaghi Hajiaghayi

Feature selection aims to identify the optimal feature subset for enhancing downstream models. Effective feature selection can remove redundant features, save computational resources, accelerate the model learning process, and improve the…

Machine Learning · Computer Science 2024-12-19 Nanxu Gong , Wangyang Ying , Dongjie Wang , Yanjie Fu

High-dimensional feature selection is a central problem in a variety of application domains such as machine learning, image analysis, and genomics. In this paper, we propose graph-based tests as a useful basis for feature selection. We…

Methodology · Statistics 2024-08-13 Swarnadip Ghosh , Somabha Mukherjee , Divyansh Agarwal , Yichen He , Mingzhi Song , Xuejiao Pei

Dynamic feature selection (DFS) is a machine learning framework in which features are acquired sequentially for individual samples under budget constraints. The exponential growth in the number of possible feature acquisition paths forces a…

Machine Learning · Computer Science 2026-05-13 Javier Fumanal-Idocin , Raquel Fernandez-Peralta , Javier Andreu-Perez

Feature selection is one of the most decisive tools in understanding data and machine learning models. Among other methods, sparsity induced by $L^{1}$ penalty is one of the simplest and best studied approaches to this problem. Although…

Machine Learning · Computer Science 2020-07-09 Andrii Trelin , Aleš Procházka

Given a set of data, biclustering aims at finding simultaneous partitions in biclusters of its samples and of the features which are used for representing the samples. Consistent biclusterings allow to obtain correct classifications of the…

Machine Learning · Computer Science 2010-03-18 Antonio Mucherino , Sonia Cafieri

Feature selection plays a pivotal role in learning, particularly in areas were parsimonious features can provide insight into the underlying process, such as biology. Recent approaches for non-linear feature selection employing greedy…

Machine Learning · Computer Science 2013-11-25 Dimitrios Athanasakis , John Shawe-Taylor , Delmiro Fernandez-Reyes

Unsupervised feature selection is an important method to reduce dimensions of high dimensional data without labels, which is benefit to avoid ``curse of dimensionality'' and improve the performance of subsequent machine learning tasks, like…

Machine Learning · Computer Science 2020-12-29 Yanyong Huang , Zongxin Shen , Fuxu Cai , Tianrui Li , Fengmao Lv

There have been several attempts to develop Feature Selection (FS) algorithms capable of identifying features that are relevant in a dataset. Although in certain applications the FS algorithms can be seen to be successful, they have similar…

Machine Learning · Computer Science 2025-03-18 Andrew Starkey , Uduak Idio Akpan , Omaimah AL Hosni , Yaseen Pullissery