English
Related papers

Related papers: Riemannian Manifold Optimization for Discriminant …

200 papers

Data dimension reduction (DDR) is all about mapping data from high dimensions to low dimensions, various techniques of DDR are being used for image dimension reduction like Random Projections, Principal Component Analysis (PCA), the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Wisal Khan , Muhammad Turab , Waqas Ahmad , Syed Hasnat Ahmad , Kelash Kumar , Bin Luo

In this paper, we propose a new variant of Linear Discriminant Analysis to overcome underlying drawbacks of traditional LDA and other LDA variants targeting problems involving imbalanced classes. Traditional LDA sets assumptions related to…

Computer Vision and Pattern Recognition · Computer Science 2018-02-20 Lei Xu , Alexandros Iosifidis , Moncef Gabbouj

The focus of this paper is to extend Fisher's linear discriminant analysis (LDA) to both densely re-corded functional data and sparsely observed longitudinal data for general $c$-category classification problems. We propose an efficient…

Methodology · Statistics 2017-09-07 Lu-Hung Chen , Ci-Ren Jiang

Higher-order data with high dimensionality is of immense importance in many areas of machine learning, computer vision, and video analytics. Multidimensional arrays (commonly referred to as tensors) are used for arranging higher-order data…

Machine Learning · Computer Science 2022-05-20 Cagri Ozdemir , Randy C. Hoover , Kyle Caudle , Karen Braman

Conjugate gradient (CG) methods are widely acknowledged as efficient for minimizing continuously differentiable functions in Euclidean spaces. In recent years, various CG methods have been extended to Riemannian manifold optimization, but…

Optimization and Control · Mathematics 2026-05-26 Chunming Tang , Shaohui Liang , Huangyue Chen

In this paper we propose an approach for learning low dimensional optimized feature space with minimum intra-class variance and maximum inter-class variance. We address the problem of high-dimensionality of feature vectors extracted from…

Image and Video Processing · Electrical Eng. & Systems 2020-01-31 Abin Jose , Erik Stefan Ottlik , Christian Rohlfing , Jens-Rainer Ohm

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino

Linear discriminant analysis (LDA) based classifiers tend to falter in many practical settings where the training data size is smaller than, or comparable to, the number of features. As a remedy, different regularized LDA (RLDA) methods…

Machine Learning · Computer Science 2021-03-30 Alam Zaib , Tarig Ballal , Shahid Khattak , Tareq Y. Al-Naffouri

This paper introduces RDA, a pioneering approach designed to address two primary deficiencies prevalent in previous endeavors aiming at stealing pre-trained encoders: (1) suboptimal performances attributed to biased optimization objectives,…

Machine Learning · Computer Science 2024-07-11 Shuchi Wu , Chuan Ma , Kang Wei , Xiaogang Xu , Ming Ding , Yuwen Qian , Tao Xiang

This survey is written in summer, 2016. The purpose of this survey is to briefly introduce nonlinear dimensionality reduction (NLDR) in data reduction. The first two NLDR were respectively published in Science in 2000 in which they solve…

Machine Learning · Computer Science 2022-03-22 Ce Ju

Few-shot learning for image classification comes up as a hot topic in computer vision, which aims at fast learning from a limited number of labeled images and generalize over the new tasks. In this paper, motivated by the idea of Fisher…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Qijun Song , Siyun Zhou , Liwei Xu

Riemannian optimization uses local methods to solve optimization problems whose constraint set is a smooth manifold. A linear step along some descent direction usually leaves the constraints, and hence retraction maps are used to…

Statistics Theory · Mathematics 2023-01-19 Alexander Heaton , Matthias Himmelmann

The problem of identifying geometric structure in data is a cornerstone of (unsupervised) learning. As a result, Geometric Representation Learning has been widely applied across scientific and engineering domains. In this work, we…

Machine Learning · Computer Science 2025-06-03 Imran Nasim , Melanie Weber

Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on…

Machine Learning · Computer Science 2019-09-19 Jindong Wang , Yiqiang Chen , Wenjie Feng , Han Yu , Meiyu Huang , Qiang Yang

Advanced representation learning techniques require reliable and general evaluation methods. Recently, several algorithms based on the common idea of geometric and topological analysis of a manifold approximated from the learned data…

Machine Learning · Computer Science 2022-02-15 Petra Poklukar , Vladislav Polianskii , Anastasia Varava , Florian Pokorny , Danica Kragic

Researchers in the behavioral and social sciences use linear discriminant analysis (LDA) for predictions of group membership (classification) and for identifying the variables most relevant to group separation among a set of continuous…

Methodology · Statistics 2025-05-28 Ricarda Graf , Marina Zeldovich , Sarah Friedrich

Monocular 3D lane detection remains challenging due to depth ambiguity and weak geometric constraints. Mainstream methods rely on depth guidance, BEV projection, and anchor- or curve-based heads with simplified physical assumptions,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chengzhi Hong , Bijun Li

We consider the linear discriminant analysis problem in the high-dimensional settings. In this work, we propose PANDA(PivotAl liNear Discriminant Analysis), a tuning-insensitive method in the sense that it requires very little effort to…

Statistics Theory · Mathematics 2023-09-19 Ethan X. Fang , Yajun Mei , Yuyang Shi , Qunzhi Xu , Tuo Zhao

Symmetric Positive Definite (SPD) matrices have been widely used for data representation in many visual recognition tasks. The success mainly attributes to learning discriminative SPD matrices with encoding the Riemannian geometry of the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-18 Zhiwu Huang , Ruiping Wang , Xianqiu Li , Wenxian Liu , Shiguang Shan , Luc Van Gool , Xilin Chen

We consider optimization problems on manifolds with equality and inequality constraints. A large body of work treats constrained optimization in Euclidean spaces. In this work, we consider extensions of existing algorithms from the…

Optimization and Control · Mathematics 2019-04-26 Changshuo Liu , Nicolas Boumal