English
Related papers

Related papers: Permutation-based multi-objective evolutionary fea…

200 papers

We introduce a novel ensemble approach for feature selection based on hierarchical stacking for non-stationarity and/or a limited number of samples with a large number of features. Our approach exploits the co-dependency between features…

Machine Learning · Computer Science 2024-10-08 Aysin Tumay , Mustafa E. Aydin , Ali T. Koc , Suleyman S. Kozat

The optimization of over-parameterized deep neural networks represents a large-scale, high-dimensional, and strongly non-convex decision problem that challenges existing optimization frameworks. Current evolutionary and gradient-based…

Neural and Evolutionary Computing · Computer Science 2026-04-02 Zak Khan , Azam Asilian Bidgoli

One of the central issues of several machine learning applications on real data is the choice of the input features. Ideally, the designer should select only the relevant, non-redundant features to preserve the complete information…

Machine Learning · Computer Science 2023-03-28 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Dimensionality reduction has become an important research topic as demand for interpreting high-dimensional datasets has been increasing rapidly in recent years. There have been many dimensionality reduction methods with good performance in…

Machine Learning · Computer Science 2022-12-01 Qiaodan Luo , Leonardo Christino , Fernando V Paulovich , Evangelos Milios

With the advent of extremely high dimensional datasets, dimensionality reduction techniques are becoming mandatory. Among many techniques, feature selection has been growing in interest as an important tool to identify relevant features on…

In this paper, we investigate dynamic feature selection within multivariate time-series scenario, a common occurrence in clinical prediction monitoring where each feature corresponds to a bio-test result. Many existing feature selection…

Machine Learning · Computer Science 2024-05-31 Yutong Chen , Jiandong Gao , Ji Wu

In recent years, deep learning has been at the center of analytics due to its impressive empirical success in analyzing complex data objects. Despite this success, most of the existing tools behave like black-box machines, thus the…

Machine Learning · Statistics 2022-11-02 Arkaprabha Ganguli , David Todem , Tapabrata Maiti

This paper describes a distributed MapReduce implementation of the minimum Redundancy Maximum Relevance algorithm, a popular feature selection method in bioinformatics and network inference problems. The proposed approach handles both…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-08 Claudio Reggiani , Yann-Aël Le Borgne , Gianluca Bontempi

Multi-objective feature selection is one of the most significant issues in the field of pattern recognition. It is challenging because it maximizes the classification performance and, at the same time, minimizes the number of selected…

Artificial Intelligence · Computer Science 2022-11-11 Motahare Namakin , Modjtaba Rouhani , Mostafa Sabzekar

Learning high-quality feature embeddings efficiently and effectively is critical for the performance of web-scale machine learning systems. A typical model ingests hundreds of features with vocabularies on the order of millions to billions…

Machine Learning · Computer Science 2024-06-19 Benjamin Coleman , Wang-Cheng Kang , Matthew Fahrbach , Ruoxi Wang , Lichan Hong , Ed H. Chi , Derek Zhiyuan Cheng

Effective features can improve the performance of a model, which can thus help us understand the characteristics and underlying structure of complex data. Previous feature selection methods usually cannot keep more local structure…

Machine Learning · Computer Science 2019-10-10 Xia Wu , Xueyuan Xu , Jianhong Liu , Hailing Wang , Bin Hu , Feiping Nie

In this paper a hybrid feature selection method is proposed which takes advantages of wrapper subset evaluation with a lower cost and improves the performance of a group of classifiers. The method uses combination of sample domain filtering…

Machine Learning · Computer Science 2014-03-12 Mehdi Naseriparsa , Amir-Masoud Bidgoli , Touraj Varaee

In classification problems, the purpose of feature selection is to identify a small, highly discriminative subset of the original feature set. In many applications, the dataset may have thousands of features and only a few dozens of samples…

Machine Learning · Computer Science 2020-08-28 Ludmila I. Kuncheva , Clare E. Matthews , Álvar Arnaiz-González , Juan J. Rodríguez

Feature selection with large-scale high-dimensional data is important yet very challenging in machine learning and data mining. Online feature selection is a promising new paradigm that is more efficient and scalable than batch feature…

Machine Learning · Computer Science 2015-11-20 Yue Wu , Steven C. H. Hoi , Tao Mei , Nenghai Yu

Feature importance ranking has become a powerful tool for explainable AI. However, its nature of combinatorial optimization poses a great challenge for deep learning. In this paper, we propose a novel dual-net architecture consisting of…

Machine Learning · Computer Science 2020-10-20 Maksymilian Wojtas , Ke Chen

Indoor image features extraction is a fundamental problem in multiple fields such as image processing, pattern recognition, robotics and so on. Nevertheless, most of the existing feature extraction methods, which extract features based on…

Computer Vision and Pattern Recognition · Computer Science 2020-01-23 Chiranjibi Sitaula , Yong Xiang , Yushu Zhang , Xuequan Lu , Sunil Aryal

Uplift modeling is a causal learning technique that estimates subgroup-level treatment effects. It is commonly used in industry and elsewhere for tasks such as targeting ads. In a typical setting, uplift models can take thousands of…

Machine Learning · Computer Science 2022-07-15 Zhenyu Zhao , Yumin Zhang , Totte Harinen , Mike Yung

Selecting a small set of informative features from a large number of possibly noisy candidates is a challenging problem with many applications in machine learning and approximate Bayesian computation. In practice, the cost of computing…

Methodology · Statistics 2022-09-05 Louis Raynal , Till Hoffmann , Jukka-Pekka Onnela

Feature transformation for AI is an essential task to boost the effectiveness and interpretability of machine learning (ML). Feature transformation aims to transform original data to identify an optimal feature space that enhances the…

Machine Learning · Computer Science 2023-01-03 Meng Xiao , Dongjie Wang , Min Wu , Ziyue Qiao , Pengfei Wang , Kunpeng Liu , Yuanchun Zhou , Yanjie Fu

High-dimensional, low sample-size (HDLSS) data problems have been a topic of immense importance for the last couple of decades. There is a vast literature that proposed a wide variety of approaches to deal with this situation, among which…

Methodology · Statistics 2021-07-09 Kaixu Yang , Tapabrata Maiti