English
Related papers

Related papers: New wrapper method based on normalized mutual info…

200 papers

The support vector machine (SVM) is a supervised learning algorithm that finds a maximum-margin linear classifier, often after mapping the data to a high-dimensional feature space via the kernel trick. Recent work has demonstrated that in…

Machine Learning · Statistics 2026-04-16 Chiraag Kaushik , Andrew D. McRae , Mark A. Davenport , Vidya Muthukumar

The aim of this work is to develop a comprehensive method for classifying sources in large sky surveys and we apply the techniques to the VIMOS Public Extragalactic Redshift Survey (VIPERS). Using the optical (u*, g', r', i') and NIR data…

The selection of features that are relevant for a prediction or classification problem is an important problem in many domains involving high-dimensional data. Selecting features helps fighting the curse of dimensionality, improving the…

Machine Learning · Computer Science 2009-09-04 Michel Verleysen , Fabrice Rossi , Damien François

Recent advancements in information technology and the widespread use of the Internet have led to easier access to data worldwide. As a result, transmitting data through noisy channels is inevitable. Reducing the size of data and protecting…

Due to the lack of a definitive ground truth for the image fusion problem, the loss functions are structured based on evaluation metrics, such as the structural similarity index measure (SSIM). However, in doing so, a bias is introduced…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Aytekin Erdogan , Erdem Akagündüz

The ability of machine learning (ML) algorithms to generalize well to unseen data has been studied through the lens of information theory, by bounding the generalization error with the input-output mutual information (MI), i.e., the MI…

Machine Learning · Statistics 2024-06-07 Kimia Nadjahi , Kristjan Greenewald , Rickard Brüel Gabrielsson , Justin Solomon

The goal of data selection is to capture the most structural information from a set of data. This paper presents a fast and accurate data selection method, in which the selected samples are optimized to span the subspace of all data. We…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Mohsen Joneidi , Alireza Zaeemzadeh , Nazanin Rahnavard , Mubarak Shah

We introduce Noisy Feature Mixup (NFM), an inexpensive yet effective method for data augmentation that combines the best of interpolation based training and noise injection schemes. Rather than training with convex combinations of pairs of…

Machine Learning · Computer Science 2023-05-23 Soon Hoe Lim , N. Benjamin Erichson , Francisco Utrera , Winnie Xu , Michael W. Mahoney

Feature selection is generally used as one of the most important preprocessing techniques in machine learning, as it helps to reduce the dimensionality of data and assists researchers and practitioners in understanding data. Thereby, by…

Machine Learning · Computer Science 2021-04-26 Yiwen Liao , Raphaël Latty , Bin Yang

We propose a novel approach to the problem of mutual information (MI) estimation via introducing a family of estimators based on normalizing flows. The estimator maps original data to the target distribution, for which MI is easier to…

Machine Learning · Computer Science 2024-05-28 Ivan Butakov , Alexander Tolmachev , Sofia Malanchuk , Anna Neopryatnaya , Alexey Frolov

Hyperspectral (HS) unmixing is the process of decomposing an HS image into material-specific spectra (endmembers) and their spatial distributions (abundance maps). Existing unmixing methods have two limitations with respect to noise…

Image and Video Processing · Electrical Eng. & Systems 2024-03-20 Kazuki Naganuma , Shunsuke Ono

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

Feature selection methods are usually evaluated by wrapping specific classifiers and datasets in the evaluation process, resulting very often in unfair comparisons between methods. In this work, we develop a theoretical framework that…

Machine Learning · Statistics 2016-10-11 Cláudia Pascoal , M. Rosário Oliveira , António Pacheco , Rui Valadas

In this paper, a novel statistical metric learning is developed for spectral-spatial classification of the hyperspectral image. First, the standard variance of the samples of each class in each batch is used to decrease the intra-class…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Zhiqiang Gong , Ping Zhong , Weidong Hu , Zixuan Xiao , Xuping Yin

A central problem in hyperspectral image classification is obtaining high classification accuracy when using a limited amount of labelled data. In this paper we present a novel graph-based framework, which aims to tackle this problem in the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Philip Sellars , Angelica Aviles-Rivero , Carola-Bibiane Schönlieb

Because anomalous samples cannot be used for training, many anomaly detection and localization methods use pre-trained networks and non-parametric modeling to estimate encoded feature distribution. However, these methods neglect the impact…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Jaehyeok Bae , Jae-Han Lee , Seyun Kim

This paper presents a variational based approach to fusing hyperspectral and multispectral images. The fusion process is formulated as an inverse problem whose solution is the target image assumed to live in a much lower dimensional…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Qi Wei , José Bioucas-Dias , Nicolas Dobigeon , Jean-Yves Tourneret

Support vector machine (SVM) is a popular classifier known for accuracy, flexibility, and robustness. However, its intensive computation has hindered its application to large-scale datasets. In this paper, we propose a new optimal leverage…

Methodology · Statistics 2023-08-25 Yixin Han , Jun Yu , Nan Zhang , Cheng Meng , Ping Ma , Wenxuan Zhong , Changliang Zou

Mutual Information (MI) is often used for feature selection when developing classifier models. Estimating the MI for a subset of features is often intractable. We demonstrate, that under the assumptions of conditional independence, MI…

Machine Learning · Computer Science 2017-06-26 Hemanth Venkateswara , Prasanth Lade , Binbin Lin , Jieping Ye , Sethuraman Panchanathan

The core of cross-modal matching is to accurately measure the similarity between different modalities in a unified representation space. However, compared to textual descriptions of a certain perspective, the visual modality has more…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenzhang Wei , Zhipeng Gui , Changguang Wu , Anqi Zhao , Dehua Peng , Huayi Wu