English
Related papers

Related papers: Feature Selection Tutorial with Python Examples

200 papers

Recent discussion of the success of feature selection methods has argued that focusing on a relatively small number of features has been counterproductive. Instead, it is suggested, the number of significant features can be in the thousands…

Statistics Theory · Mathematics 2014-07-10 Peter Hall , Jiashun Jin , Hugh Miller

Neural networks outperform kernel methods, sometimes by orders of magnitude, e.g. on staircase functions. This advantage stems from the ability of neural networks to learn features, adapting their hidden representations to better capture…

Machine Learning · Computer Science 2025-07-29 Niclas Alexander Göring , Charles London , Abdurrahman Hadi Erturk , Chris Mingard , Yoonsoo Nam , Ard A. Louis

This paper discusses predictive inference and feature selection for generalized linear models with scarce but high-dimensional data. We argue that in many cases one can benefit from a decision theoretically justified two-stage approach:…

Machine Learning · Statistics 2020-11-09 Juho Piironen , Markus Paasiniemi , Aki Vehtari

In many real-world scenarios where data is high dimensional, test time acquisition of features is a non-trivial task due to costs associated with feature acquisition and evaluating feature value. The need for highly confident models with an…

Machine Learning · Computer Science 2019-09-17 Orpaz Goldstein , Mohammad Kachuee , Kimmo Karkkainen , Majid Sarrafzadeh

The purpose of feature extraction on convolutional neural networks is to reuse deep representations learnt for a pre-trained model to solve a new, potentially unrelated problem. However, raw feature extraction from all layers is unfeasible…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Victor Gimenez-Abalos , Armand Vilalta , Dario Garcia-Gasulla , Jesus Labarta , Eduard Ayguadé

With the decreasing cost of data collection, the space of variables or features that can be used to characterize a particular predictor of interest continues to grow exponentially. Therefore, identifying the most characterizing features…

Machine Learning · Computer Science 2021-01-26 Sali Rasoul , Sodiq Adewole , Alphonse Akakpo

The rapid advancement of Large Language Models (LLMs) has significantly influenced various domains, leveraging their exceptional few-shot and zero-shot learning capabilities. In this work, we aim to explore and understand the LLMs-based…

Artificial Intelligence · Computer Science 2024-10-24 Dawei Li , Zhen Tan , Huan Liu

Large-scale Hierarchical Classification (HC) involves datasets consisting of thousands of classes and millions of training instances with high-dimensional features posing several big data challenges. Feature selection that aims to select…

Machine Learning · Computer Science 2017-06-07 Azad Naik , Huzefa Rangwala

Feature selection is a crucial step in developing robust and powerful machine learning models. Feature selection techniques can be divided into two categories: filter and wrapper methods. While wrapper methods commonly result in strong…

Machine Learning · Computer Science 2022-07-07 Jarne Verhaeghe , Jeroen Van Der Donckt , Femke Ongenae , Sofie Van Hoecke

Both feature selection and hyperparameter tuning are key tasks in machine learning. Hyperparameter tuning is often useful to increase model performance, while feature selection is undertaken to attain sparse models. Sparsity may yield…

Machine Learning · Statistics 2020-02-14 Martin Binder , Julia Moosbauer , Janek Thomas , Bernd Bischl

In order to ensure the reliability of the explanations of machine learning models, it is crucial to establish their advantages and limits and in which case each of these methods outperform. However, the current understanding of when and how…

Machine Learning · Computer Science 2025-02-12 Célia Wafa Ayad , Thomas Bonnier , Benjamin Bosch , Sonali Parbhoo , Jesse Read

Choosing which properties of the data to use as input to multivariate decision algorithms -- a.k.a. feature selection -- is an important step in solving any problem with machine learning. While there is a clear trend towards training…

High Energy Physics - Phenomenology · Physics 2022-12-02 Ranit Das , Gregor Kasieczka , David Shih

Feature selection is an important preprocessing step in machine learning and data mining. In real-world applications, costs, including money, time and other resources, are required to acquire the features. In some cases, there is a test…

Artificial Intelligence · Computer Science 2013-05-22 Fan Min , Qinghua Hu , William Zhu

The first step in constructing a machine learning model is defining the features of the data set that can be used for optimal learning. In this work we discuss feature selection methods, which can be used to build better models, as well as…

Machine Learning · Statistics 2018-06-19 Ankita Mangal , Elizabeth A. Holm

In this paper, we propose a machine learning model, which dynamically changes the features during training. Our main motivation is to update the model in a small content during the training process with replacing less descriptive features…

Machine Learning · Computer Science 2020-02-24 Marcell Beregi-Kovács , Ágnes Baran , András Hajdu

Trajectory analysis is not only about obtaining movement data, but it is also of paramount importance in understanding the pattern in which an object moves through space and time, as well as in predicting its next move. Due to the…

Machine Learning · Computer Science 2025-06-26 Chanuka Don Samarasinghage , Dhruv Gulabani

Feature selection is a technique in statistical prediction modeling that identifies features in a record with a strong statistical connection to the target variable. Excluding features with a weak statistical connection to the target…

Quantum Physics · Physics 2025-11-07 Andrew Vlasic , Hunter Grant , Salvatore Certo

A new line of research for feature selection based on neural networks has recently emerged. Despite its superiority to classical methods, it requires many training iterations to converge and detect informative features. The computational…

Machine Learning · Computer Science 2022-11-29 Ghada Sokar , Zahra Atashgahi , Mykola Pechenizkiy , Decebal Constantin Mocanu

One of the core applications of machine learning to knowledge discovery consists on building a function (a hypothesis) from a given amount of data (for instance a decision tree or a neural network) such that we can use it afterwards to…

Machine Learning · Computer Science 2007-05-23 Carlos Domingo , Ricard Gavalda , Osamu Watanabe

Instruction tuning is a vital step of training large language models (LLMs), so how to enhance the effect of instruction tuning has received increased attention. Existing works indicate that the quality of the dataset is more crucial than…

Computation and Language · Computer Science 2025-08-27 Bolin Zhang , Jiahao Wang , Qianlong Du , Jiajun Zhang , Zhiying Tu , Dianhui Chu