English
Related papers

Related papers: Relevant based structure learning for feature sele…

200 papers

A general formulation of optimization problems in which various candidate solutions may use different feature-sets is presented, encompassing supervised classification, automated program learning and other cases. A novel characterization of…

Machine Learning · Computer Science 2017-03-22 Ben Goertzel , Nil Geisweiller , Chris Poulin

We introduce a novel ensemble approach for feature selection based on hierarchical stacking for non-stationarity and/or a limited number of samples with a large number of features. Our approach exploits the co-dependency between features…

Machine Learning · Computer Science 2024-10-08 Aysin Tumay , Mustafa E. Aydin , Ali T. Koc , Suleyman S. Kozat

Feature selection is an important process in machine learning and knowledge discovery. By selecting the most informative features and eliminating irrelevant ones, the performance of learning algorithms can be improved and the extraction of…

Machine Learning · Computer Science 2024-01-17 Chunxu Cao , Qiang Zhang

We propose an adaptive node feature selection approach for graph neural networks (GNNs) that identifies and removes unnecessary features during training. The ability to measure how features contribute to model output is key for interpreting…

Machine Learning · Computer Science 2026-05-04 Ali Azizpour , Madeline Navarro , Santiago Segarra

There exist many high-dimensional data in real-world applications such as biology, computer vision, and social networks. Feature selection approaches are devised to confront with high-dimensional data challenges with the aim of efficient…

Machine Learning · Computer Science 2021-06-22 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

Feature selection methods are widely used in order to solve the 'curse of dimensionality' problem. Many proposed feature selection frameworks, treat all data points equally; neglecting their different representation power and importance. In…

Machine Learning · Computer Science 2018-10-04 Ammar Gilani , Maryam Amirmazlaghani

One of the most important steps toward interpretability and explainability of neural network models is feature selection, which aims to identify the subset of relevant features. Theoretical results in the field have mostly focused on the…

Machine Learning · Computer Science 2020-10-19 Vu Dinh , Lam Si Tung Ho

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

Machine Learning · Computer Science 2025-04-08 Rittwika Kansabanik , Adrian Barbu

The purpose of this study is to introduce a new approach to feature ranking for classification tasks, called in what follows greedy feature selection. In statistical learning, feature selection is usually realized by means of methods that…

Machine Learning · Statistics 2024-03-11 Fabiana Camattari , Sabrina Guastavino , Francesco Marchetti , Michele Piana , Emma Perracchione

Feature selection that selects an informative subset of variables from data not only enhances the model interpretability and performance but also alleviates the resource demands. Recently, there has been growing attention on feature…

Neural and Evolutionary Computing · Computer Science 2023-03-15 Zahra Atashgahi , Xuhao Zhang , Neil Kichler , Shiwei Liu , Lu Yin , Mykola Pechenizkiy , Raymond Veldhuis , Decebal Constantin Mocanu

We consider the problem of classifying business process instances based on structural features derived from event logs. The main motivation is to provide machine learning based techniques with quick response times for interactive computer…

Machine Learning · Computer Science 2018-05-18 Markku Hinkka , Teemu Lehto , Keijo Heljanko , Alexander Jung

We study the effectiveness of non-uniform randomized feature selection in decision tree classification. We experimentally evaluate two feature selection methodologies, based on information extracted from the provided dataset: $(i)$…

Machine Learning · Statistics 2014-03-25 Anastasios Kyrillidis , Anastasios Zouzias

In Machine Learning, feature selection entails selecting a subset of the available features in a dataset to use for model development. There are many motivations for feature selection, it may result in better models, it may provide insight…

Machine Learning · Computer Science 2021-06-14 Padraig Cunningham , Bahavathy Kathirgamanathan , Sarah Jane Delany

Major complications arise from the recent increase in the amount of high-dimensional data, including high computational costs and memory requirements. Feature selection, which identifies the most relevant and informative attributes of a…

Feature selection is the problem of selecting a subset of features for a machine learning model that maximizes model quality subject to a budget constraint. For neural networks, prior methods, including those based on $\ell_1$…

Machine Learning · Computer Science 2024-06-19 Taisuke Yasuda , MohammadHossein Bateni , Lin Chen , Matthew Fahrbach , Gang Fu , Vahab Mirrokni

The selection of features is an essential data preprocessing stage in data mining. The core principle of feature selection seems to be to pick a subset of possible features by excluding features with almost no predictive information as well…

Machine Learning · Computer Science 2020-08-11 Mehrdad Rostami , Kamal Berahmand , Saman Forouzandeh

In this paper, we propose a novel semi-supervised feature selection framework by mining correlations among multiple tasks and apply it to different multimedia applications. Instead of independently computing the importance of features for…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Yi Yang

A feature selection algorithm should ideally satisfy four conditions: reliably extract relevant features; be able to identify non-linear feature interactions; scale linearly with the number of features and dimensions; allow the…

Machine Learning · Computer Science 2019-01-15 Zhixiang Eddie Xu , Gao Huang , Kilian Q. Weinberger , Alice X. Zheng

An important characteristic of neural networks is their ability to learn representations of the input data with effective features for prediction, which is believed to be a key factor to their superior empirical performance. To better…

Machine Learning · Computer Science 2022-06-06 Zhenmei Shi , Junyi Wei , Yingyu Liang

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan