English
Related papers

Related papers: Toward Optimal Feature Selection in Naive Bayes fo…

200 papers

With the decreasing cost of data collection, the space of variables or features that can be used to characterize a particular predictor of interest continues to grow exponentially. Therefore, identifying the most characterizing features…

Machine Learning · Computer Science 2021-01-26 Sali Rasoul , Sodiq Adewole , Alphonse Akakpo

In this paper, we present a novel approach for object recognition in real-time by employing multilevel feature analysis and demonstrate the practicality of adapting feature extraction into a Naive Bayesian classification framework that…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Yang Cheng , Timeo Dubois

Feature selection represents a measure to reduce the complexity of high-dimensional datasets and gain insights into the systematic variation in the data. This aspect is of specific importance in domains that rely on model interpretability,…

Machine Learning · Computer Science 2022-09-07 Anna Jenul , Stefan Schrunner , Jürgen Pilz , Oliver Tomic

Feature selection has remained a daunting challenge in machine learning and artificial intelligence, where increasingly complex, high-dimensional datasets demand principled strategies for isolating the most informative predictors. Despite…

Machine Learning · Statistics 2025-12-02 Mousam Sinha , Tirtha Sarathi Ghosh , Ridam Pal

We present three related ways of using Transfer Learning to improve feature selection. The three methods address different problems, and hence share different kinds of information between tasks or feature classes, but all three are based on…

Machine Learning · Computer Science 2009-05-26 Paramveer S. Dhillon , Dean Foster , Lyle Ungar

The training of deep-learning-based text classification models relies heavily on a huge amount of annotation data, which is difficult to obtain. When the labeled data is scarce, models tend to struggle to achieve satisfactory performance.…

Computation and Language · Computer Science 2020-04-07 Dianbo Sui , Yubo Chen , Binjie Mao , Delai Qiu , Kang Liu , Jun Zhao

Feature selection helps reduce data acquisition costs in ML, but the standard approach is to train models with static feature subsets. Here, we consider the dynamic feature selection (DFS) problem where a model sequentially queries features…

Machine Learning · Computer Science 2023-06-09 Ian Covert , Wei Qiu , Mingyu Lu , Nayoon Kim , Nathan White , Su-In Lee

The goal of feature selection is to choose the optimal subset of features for a recognition task by evaluating the importance of each feature, thereby achieving effective dimensionality reduction. Currently, proposed feature selection…

Machine Learning · Computer Science 2024-02-27 Zhenxing Zhang , Jun Ge , Zheng Wei , Chunjie Zhou , Yilei Wang

Various text analysis techniques exist, which attempt to uncover unstructured information from text. In this work, we explore using statistical dependence measures for textual classification, representing text as word vectors. Student…

Computation and Language · Computer Science 2018-08-01 Samuel Cunningham-Nelson , Mahsa Baktashmotlagh , Wageeh Boles

Rankings, especially those in search and recommendation systems, often determine how people access information and how information is exposed to people. Therefore, how to balance the relevance and fairness of information exposure is…

Information Retrieval · Computer Science 2021-02-22 Tao Yang , Qingyao Ai

Amid a tidal wave of misinformation flooding social media during elections and crises, extensive research has been conducted on misinformation detection, primarily focusing on text-based or image-based approaches. However, only a few…

Machine Learning · Computer Science 2025-07-04 Gautam Kishore Shahi

In this paper, we propose a new max-margin based discriminative feature learning method. Specifically, we aim at learning a low-dimensional feature representation, so as to maximize the global margin of the data and make the samples from…

Machine Learning · Computer Science 2017-04-04 Changsheng Li , Qingshan Liu , Weishan Dong , Xin Zhang , Lin Yang

We report our ongoing work about a new deep architecture working in tandem with a statistical test procedure for jointly training texts and their label descriptions for multi-label and multi-class classification tasks. A statistical…

Computation and Language · Computer Science 2019-06-18 Ahmad Aghaebrahimian , Mark Cieliebak

Choosing which properties of the data to use as input to multivariate decision algorithms -- a.k.a. feature selection -- is an important step in solving any problem with machine learning. While there is a clear trend towards training…

High Energy Physics - Phenomenology · Physics 2022-12-02 Ranit Das , Gregor Kasieczka , David Shih

Ensembles of Convolutional neural networks have shown remarkable results in learning discriminative semantic features for image classification tasks. Though, the models in the ensemble often concentrate on similar regions in images. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Tobias Schlagenhauf , Yiwen Lin , Benjamin Noack

This paper proposes a new feature screening method for the multi-response ultrahigh dimensional linear model by empirical likelihood. Through a multivariate moment condition, the empirical likelihood induced ranking statistics can exploit…

Methodology · Statistics 2022-06-07 Jun Lu , Qinqin Hu , Lu Lin

This paper focuses on parameter estimation and introduces a new method for lower bounding the Bayesian risk. The method allows for the use of virtually \emph{any} information measure, including R\'enyi's $\alpha$, $\varphi$-Divergences, and…

Information Theory · Computer Science 2023-03-27 Amedeo Roberto Esposito , Adrien Vandenbroucque , Michael Gastpar

In this paper we introduce objective proper prior distributions for hypothesis testing and model selection based on measures of divergence between the competing models; we call them divergence based (DB) priors. DB priors have simple forms…

Methodology · Statistics 2009-02-27 M. J. Bayarri , G. García-Donato

Recent discussion of the success of feature selection methods has argued that focusing on a relatively small number of features has been counterproductive. Instead, it is suggested, the number of significant features can be in the thousands…

Statistics Theory · Mathematics 2014-07-10 Peter Hall , Jiashun Jin , Hugh Miller

Feature learning forms the cornerstone for tackling challenging learning problems in domains such as speech, computer vision and natural language processing. In this paper, we consider a novel class of matrix and tensor-valued features,…

Machine Learning · Computer Science 2014-12-12 Majid Janzamin , Hanie Sedghi , Anima Anandkumar