English
Related papers

Related papers: Feature Selection Based on Unique Relevant Informa…

200 papers

A common approach for feature selection is to examine the variable importance scores for a machine learning model, as a way to understand which features are the most relevant for making predictions. Given the significance of feature…

Machine Learning · Computer Science 2021-05-13 Jack Dunn , Luca Mingardi , Ying Daisy Zhuo

Feature selection is used to eliminate redundant features and keep relevant features, it can enhance machine learning algorithm's performance and accelerate computing speed. In various methods, mutual information has attracted increasingly…

Information Theory · Computer Science 2023-06-28 Gaoshuai Wang , Fabrice Lauri , Pu Wang , Hongyuan Luo , Amir Hajjam lL Hassani

Nowadays, feature selection is frequently used in machine learning when there is a risk of performance degradation due to overfitting or when computational resources are limited. During the feature selection process, the subset of features…

Machine Learning · Computer Science 2023-01-02 Sergey A. Saltykov

Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Farshad G. Veshki , Nora Ouzir , Sergiy A. Vorobyov , Esa Ollila

Mutual information (MI) is a fundamental measure of statistical dependence, with a myriad of applications to information theory, statistics, and machine learning. While it possesses many desirable structural properties, the estimation of…

Information Theory · Computer Science 2021-10-19 Ziv Goldfeld , Kristjan Greenewald

Due to the complexity of cancer, clustering algorithms have been used to disentangle the observed heterogeneity and identify cancer subtypes that can be treated specifically. While kernel based clustering approaches allow the use of more…

Machine Learning · Statistics 2018-11-21 Nora K. Speicher , Nico Pfeifer

Recommender system data presents unique challenges to the data mining, machine learning, and algorithms communities. The high missing data rate, in combination with the large scale and high dimensionality that is typical of recommender…

Information Retrieval · Computer Science 2017-03-22 Veronika Strnadova-Neeley , Aydin Buluc , John R. Gilbert , Leonid Oliker , Weimin Ouyang

In machine learning applications for online product offerings and marketing strategies, there are often hundreds or thousands of features available to build such models. Feature selection is one essential method in such applications for…

Machine Learning · Statistics 2019-08-16 Zhenyu Zhao , Radhika Anand , Mallory Wang

There exist many high-dimensional data in real-world applications such as biology, computer vision, and social networks. Feature selection approaches are devised to confront with high-dimensional data challenges with the aim of efficient…

Machine Learning · Computer Science 2021-06-22 Mohsen Ghassemi Parsa , Hadi Zare , Mehdi Ghatee

We develop here a data-driven approach for disease recognition based on given symptoms, to be efficient tool for anomaly detection. In a clinical setting and when presented with a patient with a combination of traits, a doctor may wonder if…

Populations and Evolution · Quantitative Biology 2020-05-01 Abd AlRahman AlMomani , Erik Bollt

Feature selection and instance selection are two important techniques of data processing. However, such selections have mostly been studied separately, while existing work towards the joint selection conducts feature/instance selection…

Machine Learning · Computer Science 2022-05-18 Wei Fan , Kunpeng Liu , Hao Liu , Hengshu Zhu , Hui Xiong , Yanjie Fu

For many data-intensive tasks, feature selection is an important preprocessing step. However, most existing methods do not directly and intuitively explore the intrinsic discriminative information of features. We propose a novel feature…

Machine Learning · Computer Science 2024-01-17 Chunxu Cao , Qiang Zhang

Online selection of dynamic features has attracted intensive interest in recent years. However, existing online feature selection methods evaluate features individually and ignore the underlying structure of feature stream. For instance, in…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Jing Wang , Meng Wang , Peipei Li , Luoqi Liu , Zhongqiu Zhao , Xuegang Hu , Xindong Wu

Information integration plays a pivotal role in biomedical studies by facilitating the combination and analysis of independent datasets from multiple studies, thereby uncovering valuable insights that might otherwise remain obscured due to…

Methodology · Statistics 2024-07-02 Chixiang Chen , Jia Liang , Elynn Chen , Ming Wang

In this paper, we propose a new deep feature selection method based on deep architecture. Our method uses stacked auto-encoders for feature representation in higher-level abstraction. We developed and applied a novel feature learning…

Machine Learning · Computer Science 2017-04-21 Milad Zafar Nezhad , Dongxiao Zhu , Xiangrui Li , Kai Yang , Phillip Levy

In recent years the importance of finding a meaningful pattern from huge datasets has become more challenging. Data miners try to adopt innovative methods to face this problem by applying feature selection methods. In this paper we propose…

Machine Learning · Computer Science 2014-03-11 Mehdi Naseriparsa , Amir-masoud Bidgoli , Touraj Varaee

Set classification problems arise when classification tasks are based on sets of observations as opposed to individual observations. In set classification, a classification rule is trained with $N$ sets of observations, where each set is…

Methodology · Statistics 2016-03-08 Sungkyu Jung , Xingye Qiao

We present a novel information-theoretic approach to introduce dependency among features of a deep convolutional neural network (CNN). The core idea of our proposed method, called MUSE, is to combine MUtual information and SElf-information…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Yu Gong , Ye Yu , Gaurav Mittal , Greg Mori , Mei Chen

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Effective feature selection is critical for robust and interpretable predictive modeling in medicine, especially when risk factors matter most in extreme patient strata. Many standard selectors emphasize average associations and can miss…

Machine Learning · Statistics 2026-03-05 Agnideep Aich , Md Monzur Murshed , Sameera Hewage , Amanda Mayeaux