English
Related papers

Related papers: Supervised Quadratic Feature Analysis: Information…

200 papers

The problem of finding a reduced dimensionality representation of categorical variables while preserving their most relevant characteristics is fundamental for the analysis of complex data. Specifically, given a co-occurrence matrix of two…

Machine Learning · Computer Science 2012-12-12 Amir Globerson , Gal Chechik , Naftali Tishby

Consider a two-class classification problem where we observe samples $(X_i, Y_i)$ for i = 1, ..., n, $X_i \in R^p$ and $Y_i$ in {0, 1}. Given $Y_i = k$, $X_i$ is assumed to follow a multivariate normal distribution with mean $\mu_k \in R^k$…

Statistics Theory · Mathematics 2023-02-23 Wanjie Wang , Jingjing Wu , Zhigang Yao

Recent sharpness-aware minimisation (SAM) is known to find flat minima which is beneficial for better generalisation with improved robustness. SAM essentially modifies the loss function by reporting the maximum loss value within the small…

Machine Learning · Computer Science 2022-06-13 Minyoung Kim , Da Li , Shell Xu Hu , Timothy M. Hospedales

Fisher Discriminant Analysis (FDA) is a subspace learning method which minimizes and maximizes the intra- and inter-class scatters of data, respectively. Although, in FDA, all the pairs of classes are treated the same way, some classes are…

Machine Learning · Statistics 2020-07-01 Benyamin Ghojogh , Milad Sikaroudi , H. R. Tizhoosh , Fakhri Karray , Mark Crowley

Domain adaptation (DA) aims to generalize a learning model across training and testing data despite the mismatch of their data distributions. In light of a theoretical estimation of upper error bound, we argue in this paper that an…

Computer Vision and Pattern Recognition · Computer Science 2018-01-01 Lingkun Luo , Liming Chen , Shiqiang Hu , Ying Lu , Xiaofang Wang

Linear Discriminant Analysis (LDA) is a well-known method for dimensionality reduction and classification. Previous studies have also extended the binary-class case into multi-classes. However, many applications, such as object detection…

Machine Learning · Computer Science 2013-09-24 Gang Chen

Wasserstein Discriminant Analysis (WDA) is a new supervised method that can improve classification of high-dimensional data by computing a suitable linear map onto a lower dimensional subspace. Following the blueprint of classical Linear…

Machine Learning · Statistics 2018-09-21 Rémi Flamary , Marco Cuturi , Nicolas Courty , Alain Rakotomamonjy

Image Quality Assessment (IQA) with references plays an important role in optimizing and evaluating computer vision tasks. Traditional methods assume that all pixels of the reference and test images are fully aligned. Such Aligned-Reference…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Keke Zhang , Weiling Chen , Tiesong Zhao , Zhou Wang

Dimensionality reduction is often used as an initial step in data exploration, either as preprocessing for classification or regression or for visualization. Most dimensionality reduction techniques to date are unsupervised; they do not…

Machine Learning · Statistics 2020-06-17 Jake S. Rhodes , Adele Cutler , Guy Wolf , Kevin R. Moon

This paper presents a novel unsupervised domain adaptation framework, called Synergistic Image and Feature Adaptation (SIFA), to effectively tackle the problem of domain shift. Domain adaptation has become an important and hot topic in…

Computer Vision and Pattern Recognition · Computer Science 2019-06-19 Cheng Chen , Qi Dou , Hao Chen , Jing Qin , Pheng-Ann Heng

We explore two primary classes of approaches to dimensionality reduction (DR): Independent Dimensionality Reduction (IDR) and Simultaneous Dimensionality Reduction (SDR). In IDR methods, of which Principal Components Analysis is a…

Machine Learning · Statistics 2024-10-28 Eslam Abdelaleem , Ahmed Roman , K. Michael Martini , Ilya Nemenman

Linear discriminant analysis (LDA) is a widely used algorithm in machine learning to extract a low-dimensional representation of high-dimensional data, it features to find the orthogonal discriminant projection subspace by using the Fisher…

Machine Learning · Computer Science 2021-07-21 Wanguang Yin , Zhengming Ma , Quanying Liu

We introduce a novel geometric framework for separating the phase and the amplitude variability in functional data of the type frequently studied in growth curve analysis. This framework uses the Fisher-Rao Riemannian metric to derive a…

Statistics Theory · Mathematics 2015-03-19 Anuj Srivastava , Wei Wu , Sebastian Kurtek , Eric Klassen , J. S. Marron

Low-dimensional embeddings for data from disparate sources play critical roles in multi-modal machine learning, multimedia information retrieval, and bioinformatics. In this paper, we propose a supervised dimensionality reduction method…

Machine Learning · Computer Science 2021-01-15 Yanjun Li , Bihan Wen , Hao Cheng , Yoram Bresler

Manifold structure learning is often used to exploit geometric information among data in semi-supervised feature learning algorithms. In this paper, we find that local discriminative information is also of importance for semi-supervised…

Machine Learning · Computer Science 2016-07-12 Sen Wang , Feiping Nie , Xiaojun Chang , Xue Li , Quan Z. Sheng , Lina Yao

A typical goal of supervised dimension reduction is to find a low-dimensional subspace of the input space such that the projected input variables preserve maximal information about the output variables. The dependence maximization approach…

Machine Learning · Statistics 2015-08-06 Voot Tangkaratt , Hiroaki Sasaki , Masashi Sugiyama

In this paper, we propose a robust subspace-constrained quadratic model (SCQM) for learning low-dimensional structure from high-dimensional data. Building upon the subspace-constrained quadratic matrix factorization (SQMF) framework, the…

Machine Learning · Computer Science 2026-05-21 Zheng Zhai , Xiaohui Li

We propose a novel algorithm for supervised dimensionality reduction named Manifold Partition Discriminant Analysis (MPDA). It aims to find a linear embedding space where the within-class similarity is achieved along the direction that is…

Machine Learning · Computer Science 2020-11-24 Yang Zhou , Shiliang Sun

Person re-identification is to seek a correct match for a person of interest across views among a large number of imposters. It typically involves two procedures of non-linear feature extractions against dramatic appearance changes, and…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Lin Wu , Chunhua Shen , Anton van den Hengel

There has been a growing interest in developing image super-resolution (SR) algorithms that convert low-resolution (LR) to higher resolution images, but automatically evaluating the visual quality of super-resolved images remains a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wei Zhou , Zhou Wang