English
Related papers

Related papers: Feature Selection Using Classifier in High Dimensi…

200 papers

Dynamic data selection accelerates training by sampling a changing subset of the dataset while preserving accuracy. We rethink two core notions underlying sample evaluation: representativeness and diversity. Instead of local geometric…

Artificial Intelligence · Computer Science 2026-03-06 Yuzhe Zhou , Zhenglin Hua , Haiyun Guo , Yuheng Jia

This Generalized Discriminant Analysis (GDA) has provided an extremely powerful approach to extracting non linear features. The network traffic data provided for the design of intrusion detection system always are large with ineffective…

Cryptography and Security · Computer Science 2009-11-05 Shailendra Singh , Sanjay Silakari

Our goal is to provide a review of deep learning methods which provide insight into structured high-dimensional data. Rather than using shallow additive architectures common to most statistical models, deep learning uses layers of…

Machine Learning · Statistics 2023-10-11 Nick Polson , Vadim Sokolov

Feature selection is popular for obtaining small, interpretable, yet highly accurate prediction models. Conventional feature-selection methods typically yield one feature set only, which might not suffice in some scenarios. For example,…

Machine Learning · Computer Science 2025-02-07 Jakob Bach

With the boom in IT technology, the data sets used in application are more and more larger and are described by a huge number of attributes, therefore, the feature selection become an important discipline in Knowledge discovery and data…

Information Retrieval · Computer Science 2014-05-06 Djamal Ziani

As with any task, the process of building machine learning models can benefit from prior experience. Meta-learning for classifier selection leverages knowledge about the characteristics of different datasets and/or the past performance of…

Machine Learning · Computer Science 2025-08-26 Sebastian Maldonado , Carla Vairetti , Ignacio Figueroa

Data selection for fine-tuning large language models (LLMs) aims to choose a high-quality subset from existing datasets, allowing the trained model to outperform baselines trained on the full dataset. However, the expanding body of research…

Computation and Language · Computer Science 2025-02-25 Ziche Liu , Rui Ke , Yajiao Liu , Feng Jiang , Haizhou Li

Introduction: Feature selection and gene set analysis are of increasing interest in bioinformatics. While these two approaches have been developed for different purposes, we describe how some gene set analysis methods can be used to conduct…

Methodology · Statistics 2015-11-30 Suyan Tian , Chi Wang , Howard H. Chang

Feature selection plays a pivotal role in learning, particularly in areas were parsimonious features can provide insight into the underlying process, such as biology. Recent approaches for non-linear feature selection employing greedy…

Machine Learning · Computer Science 2013-11-25 Dimitrios Athanasakis , John Shawe-Taylor , Delmiro Fernandez-Reyes

In high-dimensional classification problems, a commonly used approach is to first project the high-dimensional features into a lower dimensional space, and base the classification on the resulting lower dimensional projections. In this…

Statistics Theory · Mathematics 2025-08-05 Xin Bing , Marten Wegkamp

Due to the size and nature of intrusion detection datasets, intrusion detection systems (IDS) typically take high computational complexity to examine features of data and identify intrusive patterns. Data preprocessing techniques such as…

Cryptography and Security · Computer Science 2020-09-29 Mubarak Albarka Umar , Chen Zhanfang , Yan Liu

In this paper, we propose a novel semi-supervised feature selection framework by mining correlations among multiple tasks and apply it to different multimedia applications. Instead of independently computing the importance of features for…

Machine Learning · Computer Science 2017-07-11 Xiaojun Chang , Yi Yang

If the assumed model does not accurately capture the underlying structure of the data, a statistical method is likely to yield sub-optimal results, and so model selection is crucial in order to conduct any statistical analysis. However, in…

Methodology · Statistics 2023-06-21 Vasilis Chasiotis , Dimitris Karlis

For many data-intensive tasks, feature selection is an important preprocessing step. However, most existing methods do not directly and intuitively explore the intrinsic discriminative information of features. We propose a novel feature…

Machine Learning · Computer Science 2024-01-17 Chunxu Cao , Qiang Zhang

Improving the performance of classifiers is the realm of feature mapping, prototype selection, and kernel function transformations; these techniques aim for reducing the complexity, and also, improving the accuracy of models. In particular,…

Machine Learning · Computer Science 2019-10-04 Jose Ortiz-Bejar , Eric S. Tellez , Mario Graff

Identifying anomalies has become one of the primary strategies towards security and protection procedures in computer networks. In this context, machine learning-based methods emerge as an elegant solution to identify such scenarios and…

Machine Learning · Computer Science 2022-12-07 Lucas Biaggi , João P. Papa , Kelton A. P Costa , Danillo R. Pereira , Leandro A. Passos

Feature selection is a crucial step in developing robust and powerful machine learning models. Feature selection techniques can be divided into two categories: filter and wrapper methods. While wrapper methods commonly result in strong…

Machine Learning · Computer Science 2022-07-07 Jarne Verhaeghe , Jeroen Van Der Donckt , Femke Ongenae , Sofie Van Hoecke

This paper presents a versatile technique for the purpose of feature selection and extraction - Class Dependent Features (CDFs). We use CDFs to improve the accuracy of classification and at the same time control computational expense by…

Machine Learning · Computer Science 2014-12-30 Kratarth Goel , Raunaq Vohra , Ainesh Bakshi

Gradient Boosted Decision Trees (GBDTs) are widely used for building ranking and relevance models in search and recommendation. Considerations such as latency and interpretability dictate the use of as few features as possible to train…

Machine Learning · Statistics 2021-09-07 Cuize Han , Nikhil Rao , Daria Sorokina , Karthik Subbian

Set classification problems arise when classification tasks are based on sets of observations as opposed to individual observations. In set classification, a classification rule is trained with $N$ sets of observations, where each set is…

Methodology · Statistics 2016-03-08 Sungkyu Jung , Xingye Qiao