English
Related papers

Related papers: Supervised dimensionality reduction by a Linear Di…

200 papers

Reduced-rank linear discriminant analysis (RRLDA) is a foundational method of dimension reduction for classification that has been useful in a wide range of applications. The goal is to identify an optimal subspace to project the…

Computation · Statistics 2026-02-12 Jocelyn T. Chi

Linear discriminant analysis (LDA) is a classical method for dimensionality reduction, where discriminant vectors are sought to project data to a lower dimensional space for optimal separability of classes. Several recent papers have…

Computation · Statistics 2022-03-04 Summer Atkins , Gudmundur Einarsson , Brendan Ames , Line Clemmensen

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper we establish some analysis for…

Machine Learning · Computer Science 2024-01-03 Jianfei Li , Han Feng , Ding-Xuan Zhou

As one of the most popular linear subspace learning methods, the Linear Discriminant Analysis (LDA) method has been widely studied in machine learning community and applied to many scientific applications. Traditional LDA minimizes the…

Machine Learning · Computer Science 2019-07-02 Feiping Nie , Hua Wang , Zheng Wang , Heng Huang

Linear discriminant analysis (LDA) is an important classification tool in statistics and machine learning. This paper investigates the varying coefficient LDA model for dynamic data, with Bayes' discriminant direction being a function of…

Methodology · Statistics 2022-10-11 Yajie Bao , Yuyang Liu

We propose a modification of linear discriminant analysis, referred to as compressive regularized discriminant analysis (CRDA), for analysis of high-dimensional datasets. CRDA is specially designed for feature elimination purpose and can be…

Methodology · Statistics 2018-04-12 Muhammad Naveed Tabassum , Esa Ollila

There has been a great effort to transfer linear discriminant techniques that operate on vector data to high-order data, generally referred to as Multilinear Discriminant Analysis (MDA) techniques. Many existing works focus on maximizing…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

We propose a novel algorithm for supervised dimensionality reduction named Manifold Partition Discriminant Analysis (MPDA). It aims to find a linear embedding space where the within-class similarity is achieved along the direction that is…

Machine Learning · Computer Science 2020-11-24 Yang Zhou , Shiliang Sun

Linear discriminant analysis (LDA) is a well-known method for multiclass classification and dimensionality reduction. However, in general, ordinary LDA does not achieve high prediction accuracy when observations in some classes are…

Methodology · Statistics 2021-07-07 Kei Hirose , Kanta Miura , Atori Koie

Navigating the complex landscape of single-cell transcriptomic data presents significant challenges. Central to this challenge is the identification of a meaningful representation of high-dimensional gene expression patterns that sheds…

Quantitative Methods · Quantitative Biology 2023-12-13 Mu Qiao

Building extraction $-$ needed for inventory management and planning of urban environment $-$ is affected by the misalignment between labels and off-nadir source imagery in training data. Teacher-Student learning of noise-tolerant…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Bipul Neupane , Jagannath Aryal , Abbas Rajabifard

Linear discriminant analysis (LDA) has been a useful tool in pattern recognition and data analysis research and practice. While linearity of class boundaries cannot always be expected, nonlinear projections through pre-trained deep neural…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Jiahui Liu , Xiaohao Cai , Mahesan Niranjan

Latent Dirichlet Allocation (LDA) is a three-level hierarchical Bayesian model for topic inference. In spite of its great success, inferring the latent topic distribution with LDA is time-consuming. Motivated by the transfer learning…

Machine Learning · Computer Science 2015-08-06 Dongxu Zhang , Tianyi Luo , Dong Wang , Rong Liu

Suboptimal color representation often hinders accurate image segmentation, yet many modern algorithms neglect this critical preprocessing step. This work presents a novel multidimensional nonlinear discriminant analysis algorithm,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Raül Pérez-Gonzalo , Andreas Espersen , Antonio Agudo

Topological data analysis (TDA) is a relatively new field that is gaining rapid adoption due to its robustness and ability to effectively describe complex datasets by quantifying geometric information. In imaging contexts, TDA typically…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Aaryam Sharma

Linear discriminant analysis improves class separability but struggles with non-linearly separable data. To overcome this, we introduce Deep Discriminant Analysis (DDA), which directly optimizes the Fisher criterion utilizing deep networks.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Raül Pérez-Gonzalo , Andreas Espersen , Antonio Agudo

Linear discriminant analysis (LDA) is a fundamental classification and dimension reduction method that achieves Bayes optimality under Gaussian mixture, but often struggles in high-dimensional settings where the covariance matrix cannot be…

Computation · Statistics 2026-04-06 Cencheng Shen , Yuexiao Dong

We revisit Deep Linear Discriminant Analysis (Deep LDA) from a likelihood-based perspective. While classical LDA is a simple Gaussian model with linear decision boundaries, attaching an LDA head to a neural encoder raises the question of…

Machine Learning · Statistics 2026-02-23 Maxat Tezekbayev , Arman Bolatov , Zhenisbek Assylbekov

Wasserstein Discriminant Analysis (WDA) is a new supervised method that can improve classification of high-dimensional data by computing a suitable linear map onto a lower dimensional subspace. Following the blueprint of classical Linear…

Machine Learning · Statistics 2018-09-21 Rémi Flamary , Marco Cuturi , Nicolas Courty , Alain Rakotomamonjy

Regularized linear discriminant analysis (RLDA) is a widely used tool for classification and dimensionality reduction, but its performance in high-dimensional scenarios is inconsistent. Existing theoretical analyses of RLDA often lack clear…

Machine Learning · Statistics 2025-07-23 Yonghan Zhang , Zhangni Pu , Lu Yan , Jiang Hu