English
Related papers

Related papers: Discriminant Analysis with Adaptively Pooled Covar…

200 papers

We consider multi-class classification problems for high dimensional data. Following the idea of reduced-rank linear discriminant analysis (LDA), we introduce a new dimension reduction tool with a flavor of supervised principal component…

Methodology · Statistics 2017-03-28 Yue Selena Niu , Ning Hao , Bin Dong

In this paper, we propose a novel approach named by Discriminative Principal Component Analysis which is abbreviated as Discriminative PCA in order to enhance separability of PCA by Linear Discriminant Analysis (LDA). The proposed method…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Hanli Qiao

We present a randomized Kaczmarz method for linear discriminant analysis (rkLDA), an iterative randomized approach to binary-class Gaussian model linear discriminant analysis (LDA) for very large data. We harness a least squares formulation…

Computation · Statistics 2025-01-09 Jocelyn T. Chi , Deanna Needell

Multi-group classification arises in many prediction and decision-making problems, including applications in epidemiology, genomics, finance, and image recognition. Although classification methods have advanced considerably, much of the…

Methodology · Statistics 2026-01-12 Yuchao Wang , Tianying Wang

This paper proposes an improved linear discriminant analysis called spectrally-corrected and regularized LDA (SRLDA). This method integrates the design ideas of the sample spectrally-corrected covariance matrix and the regularized…

Machine Learning · Statistics 2024-03-11 Hua Li , Wenya Luo , Zhidong Bai , Huanchao Zhou , Zhangni Pu

We consider the problem of estimating high-dimensional covariance matrices of $K$-populations or classes in the setting where the sample sizes are comparable to the data dimension. We propose estimating each class covariance matrix as a…

Methodology · Statistics 2022-02-08 Elias Raninen , David E. Tyler , Esa Ollila

Linear discriminant analysis (LDA) is a classical method for dimensionality reduction, where discriminant vectors are sought to project data to a lower dimensional space for optimal separability of classes. Several recent papers have…

Computation · Statistics 2022-03-04 Summer Atkins , Gudmundur Einarsson , Brendan Ames , Line Clemmensen

Classification is an important tool with many useful applications. Among the many classification methods, Fisher's Linear Discriminant Analysis (LDA) is a traditional model-based approach which makes use of the covariance information.…

Machine Learning · Statistics 2015-09-21 Qiyi Lu , Xingye Qiao

Discriminant analysis is a useful classification method. Variable selection for discriminant analysis is becoming more and more im- portant in a high-dimensional setting. This paper is concerned with the binary-class problems of main and…

Methodology · Statistics 2017-02-16 Deqiang Zheng , Jinzhu Jia , Xiangzhong Fang , Xiuhua Guo

Classical linear discriminant analysis (LDA) is based on squared Frobenious norm and hence is sensitive to outliers and noise. To improve the robustness of LDA, in this paper, we introduce capped l_{2,1}-norm of a matrix, which employs…

Machine Learning · Statistics 2020-11-05 Jiakou Liu , Xiong Xiong , Pei-Wei Ren , Da Zhao , Chun-Na Li , Yuan-Hai Shao

In this paper, we propose a new variant of Linear Discriminant Analysis to overcome underlying drawbacks of traditional LDA and other LDA variants targeting problems involving imbalanced classes. Traditional LDA sets assumptions related to…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Lei Xu , Alexandros Iosifidis , Moncef Gabbouj

Dimensionality reduction is a crucial step for pattern recognition and data mining tasks to overcome the curse of dimensionality. Principal component analysis (PCA) is a traditional technique for unsupervised dimensionality reduction, which…

Machine Learning · Computer Science 2017-05-04 Zan Gao , Guotai Zhang , Feiping Nie , Hua Zhang

Linear discriminant analysis (LDA) based classifiers tend to falter in many practical settings where the training data size is smaller than, or comparable to, the number of features. As a remedy, different regularized LDA (RLDA) methods…

Machine Learning · Computer Science 2021-03-30 Alam Zaib , Tarig Ballal , Shahid Khattak , Tareq Y. Al-Naffouri

We present a novel approach to the formulation and the resolution of sparse Linear Discriminant Analysis (LDA). Our proposal, is based on penalized Optimal Scoring. It has an exact equivalence with penalized LDA, contrary to the multi-class…

Machine Learning · Computer Science 2012-07-03 Luis Francisco Sanchez Merchante , Yves Grandvalet , Gerrad Govaert

Linear discriminant analysis (LDA), a traditional classification tool, suffers from limitations such as sensitivity to noise and computational challenges when dealing with non-invertible within-class scatter matrices. Traditional stepwise…

Methodology · Statistics 2025-05-26 Siyu Wang , Kehui Yao

In many social, economical, biological and medical studies, one objective is to classify a subject into one of several classes based on a set of variables observed from the subject. Because the probability distribution of the variables is…

Statistics Theory · Mathematics 2011-05-19 Jun Shao , Yazhen Wang , Xinwei Deng , Sijian Wang

Linear discriminant analysis (LDA) is a well-known method for multiclass classification and dimensionality reduction. However, in general, ordinary LDA does not achieve high prediction accuracy when observations in some classes are…

Methodology · Statistics 2021-07-07 Kei Hirose , Kanta Miura , Atori Koie

This paper addresses classification problems with matrix-valued data, which commonly arise in applications such as neuroimaging and signal processing. Building on the assumption that the data from each class follows a matrix normal…

Methodology · Statistics 2025-12-18 Seungyeon Oh , Seongoh Park , Hoyoung Park

Linear discriminant analysis (LDA) is a popular technique to learn the most discriminative features for multi-class classification. A vast majority of existing LDA algorithms are prone to be dominated by the class with very large deviation…

Machine Learning · Computer Science 2020-09-28 Caixia Yan , Xiaojun Chang , Minnan Luo , Qinghua Zheng , Xiaoqin Zhang , Zhihui Li , Feiping Nie

The Engineers' Salary Prediction Challenge requires classifying salary categories into three classes based on tabular data. The job description is represented as a 300-dimensional word embedding incorporated into the tabular features,…

Machine Learning · Computer Science 2025-09-17 Liam Ressel , Hamza A. A. Gardi