English
Related papers

Related papers: Spatial Sign based Direct Sparse Linear Discrimina…

200 papers

The performance of machine learning and pattern recognition algorithms generally depends on data representation. That is why, much of the current effort in performing machine learning algorithms goes into the design of preprocessing…

Machine Learning · Computer Science 2025-10-28 Fadi Dornaika , Ahmad Khoder , Abdelmalik Moujahid , Wassim Khoder

We introduce supervised latent Dirichlet allocation (sLDA), a statistical model of labelled documents. The model accommodates a variety of response types. We derive an approximate maximum-likelihood procedure for parameter estimation, which…

Machine Learning · Statistics 2010-03-04 David M. Blei , Jon D. McAuliffe

Linear discriminant analysis improves class separability but struggles with non-linearly separable data. To overcome this, we introduce Deep Discriminant Analysis (DDA), which directly optimizes the Fisher criterion utilizing deep networks.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Raül Pérez-Gonzalo , Andreas Espersen , Antonio Agudo

Topological data analysis (TDA) has emerged as one of the most promising techniques to reconstruct the unknown shapes of high-dimensional spaces from observed data samples. TDA, thus, yields key shape descriptors in the form of persistent…

Machine Learning · Statistics 2017-11-15 Wei Guo , Krithika Manohar , Steven L. Brunton , Ashis G. Banerjee

Symbolic data analysis (SDA) is an emerging area of statistics concerned with understanding and modelling data that takes distributional form (i.e. symbols), such as random lists, intervals and histograms. It was developed under the premise…

Computation · Statistics 2020-04-09 Boris Beranger , Huan Lin , Scott A. Sisson

We propose a compressive classification framework for settings where the data dimensionality is significantly higher than the sample size. The proposed method, referred to as compressive regularized discriminant analysis (CRDA) is based on…

Machine Learning · Statistics 2020-11-13 Muhammad Naveed Tabassum , Esa Ollila

Although linear and quadratic discriminant analysis are widely recognized classical methods, they can encounter significant challenges when dealing with non-Gaussian distributions or contaminated datasets. This is primarily due to their…

Machine Learning · Statistics 2023-11-14 Pierre Houdouin , Matthieu Jonckheere , Frederic Pascal

Linear discriminant analysis (LDA) is a typical method for classification problems with large dimensions and small samples. There are various types of LDA methods that are based on the different types of estimators for the covariance…

Methodology · Statistics 2023-03-07 Jaehoan Kim , Hoyoung Park , Junyong Park

Recent studies in the literature have paid much attention to the sparsity in linear classification tasks. One motivation of imposing sparsity assumption on the linear discriminant direction is to rule out the noninformative features, making…

Machine Learning · Statistics 2015-01-13 Dong Xia

Linear discriminant analysis (LDA), a traditional classification tool, suffers from limitations such as sensitivity to noise and computational challenges when dealing with non-invertible within-class scatter matrices. Traditional stepwise…

Methodology · Statistics 2025-05-26 Siyu Wang , Kehui Yao

A major challenge in scaling object detection is the difficulty of obtaining labeled images for large numbers of categories. Recently, deep convolutional neural networks (CNNs) have emerged as clear winners on object classification…

Computer Vision and Pattern Recognition · Computer Science 2017-11-10 Judy Hoffman , Sergio Guadarrama , Eric Tzeng , Ronghang Hu , Jeff Donahue , Ross Girshick , Trevor Darrell , Kate Saenko

This paper addresses classification problems with matrix-valued data, which commonly arise in applications such as neuroimaging and signal processing. Building on the assumption that the data from each class follows a matrix normal…

Methodology · Statistics 2025-12-18 Seungyeon Oh , Seongoh Park , Hoyoung Park

Under normality and homoscedasticity assumptions, Linear Discriminant Analysis (LDA) is known to be optimal in terms of minimising the Bayes error for binary classification. In the heteroscedastic case, LDA is not guaranteed to minimise…

Machine Learning · Computer Science 2017-03-27 Kojo Sarfo Gyamfi , James Brusey , Andrew Hunt , Elena Gaura

Quadratic discriminant analysis (QDA) is a widely used classification technique that generalizes the linear discriminant analysis (LDA) classifier to the case of distinct covariance matrices among classes. For the QDA classifier to yield…

Machine Learning · Computer Science 2020-06-26 Houssem Sifaou , Abla Kammoun , Mohamed-Slim Alouini

We address the problem of robust estimation of sparse high dimensional tensor elliptical graphical model. Most of the research focus on tensor graphical model under normality. To extend the tensor graphical model to more heavy-tailed…

Methodology · Statistics 2025-08-04 Jixuan Liu , Zhengke Lu , Le Zhou , Long Feng , Zhaojun Wang

Linear Discriminant Analysis (LDA) is commonly used for dimensionality reduction in pattern recognition and statistics. It is a supervised method that aims to find the most discriminant space of reduced dimension that can be further used…

Computer Vision and Pattern Recognition · Computer Science 2021-04-19 Navya Nagananda , Breton Minnehan , Andreas Savakis

Motivation: The high dimensionality of genomic data calls for the development of specific classification methodologies, especially to prevent over-optimistic predictions. This challenge can be tackled by compression and variable selection,…

Methodology · Statistics 2021-04-10 G. Durif , L. Modolo , J. Michaelsson , J. E. Mold , S. Lambert-Lacroix , F. Picard

Classification of high-dimensional low sample size (HDLSS) data poses a challenge in a variety of real-world situations, such as gene expression studies, cancer research, and medical imaging. This article presents the development and…

Machine Learning · Statistics 2026-05-27 Jyotishka Ray Choudhury , Aytijhya Saha , Sarbojit Roy , Subhajit Dutta

In this paper, we consider the problem of linear regression with heavy-tailed distributions. Different from previous studies that use the squared loss to measure the performance, we choose the absolute loss, which is capable of estimating…

Machine Learning · Computer Science 2018-10-26 Lijun Zhang , Zhi-Hua Zhou

Linear Discriminant Analysis (LDA) is a well-known method for dimensionality reduction and classification. Previous studies have also extended the binary-class case into multi-classes. However, many applications, such as object detection…

Machine Learning · Computer Science 2013-09-24 Gang Chen