English
Related papers

Related papers: Improving feature selection algorithms using norma…

200 papers

While unbiased machine learning models are essential for many applications, bias is a human-defined concept that can vary across tasks. Given only input-label pairs, algorithms may lack sufficient information to distinguish stable (causal)…

Machine Learning · Computer Science 2022-06-28 Yujia Bao , Shiyu Chang , Regina Barzilay

In this paper, we investigate dynamic feature selection within multivariate time-series scenario, a common occurrence in clinical prediction monitoring where each feature corresponds to a bio-test result. Many existing feature selection…

Machine Learning · Computer Science 2024-05-31 Yutong Chen , Jiandong Gao , Ji Wu

This paper presents a new filter method for unsupervised feature selection. This method is particularly effective on imbalanced multi-class dataset, as in case of clusters of different anomaly types. Existing methods usually involve the…

Machine Learning · Statistics 2023-06-01 Katarina Firdova , Céline Labart , Arthur Martel

We propose a new strategy to improve the accuracy and robustness of image classification. First, we train a baseline CNN model. Then, we identify challenging regions in the feature space by identifying all misclassified samples, and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Fadoua Khmaissia , Hichem Frigui

A feature selection algorithm should ideally satisfy four conditions: reliably extract relevant features; be able to identify non-linear feature interactions; scale linearly with the number of features and dimensions; allow the…

Machine Learning · Computer Science 2019-01-15 Zhixiang Eddie Xu , Gao Huang , Kilian Q. Weinberger , Alice X. Zheng

This paper investigates two feature-scoring criteria that make use of estimated class probabilities: one method proposed by \citet{shen} and a complementary approach proposed below. We develop a theoretical framework to analyze each…

Machine Learning · Computer Science 2012-07-03 Andrea Danyluk , Nicholas Arnosti

Feature selection is crucial for pinpointing relevant features in high-dimensional datasets, mitigating the 'curse of dimensionality,' and enhancing machine learning performance. Traditional feature selection methods for classification use…

Machine Learning · Computer Science 2025-04-08 Rittwika Kansabanik , Adrian Barbu

Fitting models with high predictive accuracy that include all relevant but no irrelevant or redundant features is a challenging task on data sets with similar (e.g. highly correlated) features. We propose the approach of tuning the…

Machine Learning · Statistics 2022-03-23 Andrea Bommert , Jörg Rahnenführer , Michel Lang

We tackle the problem of Selective Classification where the objective is to achieve the best performance on a predetermined ratio (coverage) of the dataset. Recent state-of-the-art selective methods come with architectural changes either…

Machine Learning · Computer Science 2023-03-03 Leo Feng , Mohamed Osama Ahmed , Hossein Hajimirsadeghi , Amir Abdi

Feature selection has drawn much attention over the last decades in machine learning because it can reduce data dimensionality while maintaining the original physical meaning of features, which enables better interpretability than feature…

Machine Learning · Computer Science 2022-09-27 Yiwen Liao , Jochen Rivoir , Raphaël Latty , Bin Yang

For many classification and regression problems, a large number of features are available for possible use - this is typical of DNA microarray data on gene expression, for example. Often, for computational or other reasons, only a small…

Statistics Theory · Mathematics 2007-06-13 Longhai Li , Jianguo Zhang , Radford M. Neal

Feature selection methods are usually evaluated by wrapping specific classifiers and datasets in the evaluation process, resulting very often in unfair comparisons between methods. In this work, we develop a theoretical framework that…

Machine Learning · Statistics 2016-10-11 Cláudia Pascoal , M. Rosário Oliveira , António Pacheco , Rui Valadas

Stability selection is a versatile framework for structure estimation and variable selection in high-dimensional setting, primarily grounded in frequentist principles. In this paper, we propose an enhanced methodology that integrates…

Methodology · Statistics 2026-05-05 Mahdi Nouraie , Connor Smith , Samuel Muller

The Na\"ive Bayes has proven to be a tractable and efficient method for classification in multivariate analysis. However, features are usually correlated, a fact that violates the Na\"ive Bayes' assumption of conditional independence, and…

Machine Learning · Statistics 2024-02-01 Rafael Blanquero , Emilio Carrizosa , Pepa Ramírez-Cobo , M. Remedios Sillero-Denamiel

Image clustering is to group a set of images into disjoint clusters in a way that images in the same cluster are more similar to each other than to those in other clusters, which is an unsupervised or semi-supervised learning process. It is…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Bo Dong , Xinnian Wang

Incorporating feature selection into a classification or regression method often carries a number of advantages. In this paper we formalize feature selection specifically from a discriminative perspective of improving…

Machine Learning · Computer Science 2013-01-18 Tony S. Jebara , Tommi S. Jaakkola

In this paper we introduce a new feature selection algorithm to remove the irrelevant or redundant features in the data sets. In this algorithm the importance of a feature is based on its fitting to the Catastrophe model. Akaike information…

Machine Learning · Computer Science 2017-04-25 Mahdi Zarei

This paper describes a new approach for learning structures of large Bayesian networks based on blocks resulting from feature space clustering. This clustering is obtained using normalized mutual information. And the subsequent aggregation…

Machine Learning · Statistics 2022-08-30 Anna V. Bubnova

Text classification is a fundamental problem in the field of natural language processing. Text classification mainly focuses on giving more importance to all the relevant features that help classify the textual data. Apart from these, the…

Computation and Language · Computer Science 2021-01-25 Suman Dowlagar , Radhika Mamidi

A general formulation of optimization problems in which various candidate solutions may use different feature-sets is presented, encompassing supervised classification, automated program learning and other cases. A novel characterization of…

Machine Learning · Computer Science 2017-03-22 Ben Goertzel , Nil Geisweiller , Chris Poulin