English
Related papers

Related papers: Cellwise robust regularized discriminant analysis

200 papers

Linear Discriminant Analysis (LDA) is a fundamental method for classification. Its simple linear structure facilitates interpretation, and it is naturally suited to multi-class settings. LDA is also closely connected to several classical…

Methodology · Statistics 2026-04-09 Xin Bing , Bingqing Li , Marten Wegkamp

This paper proposes an improved linear discriminant analysis called spectrally-corrected and regularized LDA (SRLDA). This method integrates the design ideas of the sample spectrally-corrected covariance matrix and the regularized…

Machine Learning · Statistics 2024-03-11 Hua Li , Wenya Luo , Zhidong Bai , Huanchao Zhou , Zhangni Pu

We propose a modification of linear discriminant analysis, referred to as compressive regularized discriminant analysis (CRDA), for analysis of high-dimensional datasets. CRDA is specially designed for feature elimination purpose and can be…

Methodology · Statistics 2018-04-12 Muhammad Naveed Tabassum , Esa Ollila

There is a great need for robust techniques in data mining and machine learning contexts where many standard techniques such as principal component analysis and linear discriminant analysis are inherently susceptible to outliers.…

Methodology · Statistics 2015-09-28 Garth Tarr , Samuel Müller , Neville C. Weber

Reduced-rank linear discriminant analysis (RRLDA) is a foundational method of dimension reduction for classification that has been useful in a wide range of applications. The goal is to identify an optimal subspace to project the…

Computation · Statistics 2026-02-12 Jocelyn T. Chi

As a non-linear extension of the classic Linear Discriminant Analysis(LDA), Deep Linear Discriminant Analysis(DLDA) replaces the original Categorical Cross Entropy(CCE) loss function with eigenvalue-based loss function to make a deep neural…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Wen Lu

This paper investigates the effectiveness of using the Random Projection Ensemble (RPE) approach in Quadratic Discriminant Analysis (QDA) for ultrahigh-dimensional classification problems. Classical methods such as Linear Discriminant…

Methodology · Statistics 2025-07-10 Annesha Deb , Minerva Mukhopadhyay , Subhajit Dutta

The usual Minimum Covariance Determinant (MCD) estimator of a covariance matrix is robust against casewise outliers. These are cases (that is, rows of the data matrix) that behave differently from the majority of cases, raising suspicion…

Methodology · Statistics 2024-07-08 Jakob Raymaekers , Peter J. Rousseeuw

Quadratic discriminant analysis (QDA) is a simple method to classify a subject into two populations, and was proven to perform as well as the Bayes rule when the data dimension p is fixed. The main purpose of this paper is to examine the…

Statistics Theory · Mathematics 2018-08-31 Qing Yang , Guang Cheng

Linear discriminant analysis (LDA) is an important classification tool in statistics and machine learning. This paper investigates the varying coefficient LDA model for dynamic data, with Bayes' discriminant direction being a function of…

Methodology · Statistics 2022-10-11 Yajie Bao , Yuyang Liu

Cellwise outliers are widespread in data and traditional robust methods may fail when applied to datasets under such contamination. We propose a variable selection procedure, that uses a pairwise robust estimator to obtain an initial…

Methodology · Statistics 2023-09-06 Peng Su , Garth Tarr , Samuel Muller

Linear discriminant analysis (LDA) is a well-known method for multiclass classification and dimensionality reduction. However, in general, ordinary LDA does not achieve high prediction accuracy when observations in some classes are…

Methodology · Statistics 2021-07-07 Kei Hirose , Kanta Miura , Atori Koie

Quadratic discriminant analysis (QDA) is a standard tool for classification due to its simplicity and flexibility. Because the number of its parameters scales quadratically with the number of the variables, QDA is not practical, however,…

Methodology · Statistics 2018-09-06 Binyan Jiang , Xiangyu Wang , Chenlei Leng

In this paper, we propose a new variant of Linear Discriminant Analysis to overcome underlying drawbacks of traditional LDA and other LDA variants targeting problems involving imbalanced classes. Traditional LDA sets assumptions related to…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Lei Xu , Alexandros Iosifidis , Moncef Gabbouj

Covariance and Hessian matrices have been analyzed separately in the literature for classification problems. However, integrating these matrices has the potential to enhance their combined power in improving classification performance. We…

Machine Learning · Computer Science 2024-10-10 Agus Hartoyo , Jan Argasiński , Aleksandra Trenk , Kinga Przybylska , Anna Błasiak , Alessandro Crimi

Principal component analysis (PCA) is widely used for dimensionality reduction, with well-documented merits in various applications involving high-dimensional data, including computer vision, preference measurement, and bioinformatics. In…

Machine Learning · Statistics 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

We present a randomized Kaczmarz method for linear discriminant analysis (rkLDA), an iterative randomized approach to binary-class Gaussian model linear discriminant analysis (LDA) for very large data. We harness a least squares formulation…

Computation · Statistics 2025-01-09 Jocelyn T. Chi , Deanna Needell

In this paper, we propose a new variant of Linear Discriminant Analysis (LDA) to solve multi-label classification tasks. The proposed method is based on a probabilistic model for defining the weights of individual samples in a weighted…

Machine Learning · Computer Science 2020-04-10 Lei Xu , Jenni Raitoharju , Alexandros Iosifidis , Moncef Gabbouj

Linear discriminant analysis (LDA) is a fundamental method for feature extraction and dimensionality reduction. Despite having many variants, classical LDA has its own importance, as it is a keystone in human knowledge about statistical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Sayed Kamaledin Ghiasi-Shirazi

Regularized linear discriminant analysis (RLDA) is a widely used tool for classification and dimensionality reduction, but its performance in high-dimensional scenarios is inconsistent. Existing theoretical analyses of RLDA often lack clear…

Machine Learning · Statistics 2025-07-23 Yonghan Zhang , Zhangni Pu , Lu Yan , Jiang Hu