English
Related papers

Related papers: Best Subset Selection: Optimal Pursuit for Feature…

200 papers

Feature selection aims to select the smallest feature subset that yields the minimum generalization error. In the rich literature in feature selection, information theory-based approaches seek a subset of features such that the mutual…

Computer Vision and Pattern Recognition · Computer Science 2019-01-30 Shujian Yu , Jose C. Principe

The population-based optimization algorithms have provided promising results in feature selection problems. However, the main challenges are high time complexity. Moreover, the interaction between features is another big challenge in FS…

Neural and Evolutionary Computing · Computer Science 2021-10-26 Motahare Namakin , Modjtaba Rouhani , Mostafa Sabzekar

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

The selection of features is an essential data preprocessing stage in data mining. The core principle of feature selection seems to be to pick a subset of possible features by excluding features with almost no predictive information as well…

Machine Learning · Computer Science 2020-08-11 Mehrdad Rostami , Kamal Berahmand , Saman Forouzandeh

In recent years the importance of finding a meaningful pattern from huge datasets has become more challenging. Data miners try to adopt innovative methods to face this problem by applying feature selection methods. In this paper we propose…

Machine Learning · Computer Science 2014-03-11 Mehdi Naseriparsa , Amir-masoud Bidgoli , Touraj Varaee

Feature importance ranking has become a powerful tool for explainable AI. However, its nature of combinatorial optimization poses a great challenge for deep learning. In this paper, we propose a novel dual-net architecture consisting of…

Machine Learning · Computer Science 2020-10-20 Maksymilian Wojtas , Ke Chen

The feature subset selection problem aims at selecting the relevant subset of features to improve the performance of a Machine Learning (ML) algorithm on training data. Some features in data can be inherently noisy, costly to compute,…

Neural and Evolutionary Computing · Computer Science 2022-05-04 Ayaz Ur Rehman , Anas Nadeem , Muhammad Zubair Malik

We investigate feature selection problem for generic machine learning models. We introduce a novel framework that selects features considering the outcomes of the model. Our framework introduces a novel feature masking approach to eliminate…

Machine Learning · Computer Science 2024-12-10 Mehmet E. Lorasdagi , Mehmet Y. Turali , Suleyman S. Kozat

In this paper, two novel algorithms for features selection are proposed. The first one is a filter method while the second is wrapper method. Both the proposed algorithms use the crowding distance used in the multiobjective optimization as…

Machine Learning · Computer Science 2021-05-17 Abdesslem Layeb

In this paper we present an alternative approach to symbolic segmentation; instead of implementing a new method we approach symbolic segmentation as an algorithm selection problem. That is, let there be $n$ available algorithms for symbolic…

Computer Vision and Pattern Recognition · Computer Science 2015-06-01 Martin Lukac , Kamila Abdiyeva , Michitaka Kameyama

Best subset selection is considered the `gold standard' for many sparse learning problems. A variety of optimization techniques have been proposed to attack this non-smooth non-convex problem. In this paper, we investigate the dual forms of…

Machine Learning · Computer Science 2024-12-31 Shaogang Ren , Xiaoning Qian

Combining quantum computers with classical compute power has become a standard means for developing algorithms that are eventually supposed to beat any purely classical alternatives. While in-principle advantages for solution quality or…

Quantum Physics · Physics 2026-01-23 Simon Thelen , Wolfgang Mauerer

It has long been observed that for practically any computational problem that has been intensely studied, different instances are best solved using different algorithms. This is particularly pronounced for computationally hard problems,…

Machine Learning · Computer Science 2018-11-29 Pascal Kerschke , Holger H. Hoos , Frank Neumann , Heike Trautmann

In the last twenty-five years (1990-2014), algorithmic advances in integer optimization combined with hardware improvements have resulted in an astonishing 200 billion factor speedup in solving Mixed Integer Optimization (MIO) problems. We…

Methodology · Statistics 2015-07-14 Dimitris Bertsimas , Angela King , Rahul Mazumder

Feature selection is an essential problem in computer vision, important for category learning and recognition. Along with the rapid development of a wide variety of visual features and classifiers, there is a growing need for efficient…

Computer Vision and Pattern Recognition · Computer Science 2014-12-01 Marius Leordeanu , Alexandra Radu , Rahul Sukthankar

Feature selection is an expensive challenging task in machine learning and data mining aimed at removing irrelevant and redundant features. This contributes to an improvement in classification accuracy, as well as the budget and memory…

Machine Learning · Computer Science 2024-02-21 Sevil Zanjani Miyandoab , Shahryar Rahnamayan , Azam Asilian Bidgoli

Feature selection is an important part of building a machine learning model. By eliminating redundant or misleading features from data, the machine learning model can achieve better performance while reducing the demand on com-puting…

Machine Learning · Computer Science 2021-06-11 Song Tan , Xia He

In machine learning, fewer features reduce model complexity. Carefully assessing the influence of each input feature on the model quality is therefore a crucial preprocessing step. We propose a novel feature selection algorithm based on a…

Quantum Physics · Physics 2023-02-22 Sascha Mücke , Raoul Heese , Sabine Müller , Moritz Wolter , Nico Piatkowski

In [1], we have explored the theoretical aspects of feature selection and evolutionary algorithms. In this chapter, we focus on optimization algorithms for enhancing data analytic process, i.e., we propose to explore applications of…

Machine Learning · Computer Science 2019-08-26 Farid Ghareh Mohammadi , M. Hadi Amini , Hamid R. Arabnia

The problem of selecting an algorithm that appears most suitable for a specific instance of an algorithmic problem class, such as the Boolean satisfiability problem, is called instance-specific algorithm selection. Over the past decade, the…

Machine Learning · Computer Science 2021-07-21 Alexander Tornede , Lukas Gehring , Tanja Tornede , Marcel Wever , Eyke Hüllermeier