English
Related papers

Related papers: Locality preserving projection on SPD matrix Lie g…

200 papers

Mirror Descent (MD) is a scalable first-order method widely used in large-scale optimization, with applications in image processing, policy optimization, and neural network training. This paper generalizes MD to optimization on Riemannian…

Machine Learning · Statistics 2026-03-19 Jiaxin Jiang , Lei Shi , Jiyuan Tan

Fully connected layers are a primary source of memory and computational overhead in deep neural networks due to their dense, often redundant parameterization. While various compression techniques exist, they frequently introduce complex…

Machine Learning · Computer Science 2025-12-16 Maksymilian Szorc

In this paper a local pattern descriptor in high order derivative space is proposed for face recognition. The proposed local directional gradient pattern (LDGP) is a 1D local micropattern computed by encoding the relationships between the…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Soumendu Chakraborty , Satish Kumar Singh , Pavan Chakraborty

Leveraging on the underlying low-dimensional structure of data, low-rank and sparse modeling approaches have achieved great success in a wide range of applications. However, in many applications the data can display structures beyond simply…

Machine Learning · Computer Science 2019-12-04 Zhao Kang , Xiao Lu , Yiwei Lu , Chong Peng , Zenglin Xu

We introduce the manifold of {\it restricted} $n\times n$ positive semidefinite matrices of fixed rank $p$, denoted $S(n,p)^{*}$. The manifold itself is an open and dense submanifold of $S(n,p)$, the manifold of $n\times n$ positive…

Differential Geometry · Mathematics 2023-04-04 A. Martina Neuman , Yuying Xie , Qiang Sun

Classical unsupervised learning methods like clustering and linear dimensionality reduction parametrize large-scale geometry when it is discrete or linear, while more modern methods from manifold learning find low dimensional representation…

Machine Learning · Computer Science 2025-09-23 Luis Scoccola , Uzu Lim , Heather A. Harrington

The latent variable proximal point (LVPP) algorithm is a framework for solving infinite-dimensional variational problems with pointwise inequality constraints. The algorithm is a saddle point reformulation of the Bregman proximal point…

Optimization and Control · Mathematics 2025-07-01 Jørgen S. Dokken , Patrick E. Farrell , Brendan Keith , Ioannis P. A. Papadopoulos , Thomas M. Surowiec

We explore the use of tools from Riemannian geometry for the analysis of symmetric positive definite matrices (SPD). An SPD matrix is a versatile data representation that is commonly used in chemical engineering (e.g.,…

Applications · Statistics 2022-03-24 Alexander Smith , Benjamin Laubach , Ivan Castillo , Victor M. Zavala

This paper focuses on network pruning for image retrieval acceleration. Prevailing image retrieval works target at the discriminative feature learning, while little attention is paid to how to accelerate the model inference, which should be…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Xiaodong Wang , Zhedong Zheng , Yang He , Fei Yan , Zhiqiang Zeng , Yi Yang

We propose a novel algorithm for the fitting of 3D human shape to images. Combining the accuracy and refinement capabilities of iterative gradient-based optimization techniques with the robustness of deep neural networks, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jie Song , Xu Chen , Otmar Hilliges

Manifold learning aims to discover and represent low-dimensional structures underlying high-dimensional data while preserving critical topological and geometric properties. Existing methods often fail to capture local details with global…

Machine Learning · Computer Science 2025-05-08 Ren Wang , Pengcheng Zhou

We reconsider randomized algorithms for the low-rank approximation of symmetric positive semi-definite (SPSD) matrices such as Laplacian and kernel matrices that arise in data analysis and machine learning applications. Our main results…

Machine Learning · Computer Science 2013-06-05 Alex Gittens , Michael W. Mahoney

The task of image restration is to find the spatial correspondence of two or more given images. In this paper we assume that the correspondence is given either by an Euclidean, or by an affine volume-preserving transformation. Since the…

Optimization and Control · Mathematics 2010-07-30 Martin Schröter , Uwe Helmke , Otto Sauer

In ordinary Dimensionality Reduction (DR), each data instance in a high dimensional space (original space), or on a distance matrix denoting original space distances, is mapped to (projected onto) one point in a low dimensional space…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Farshad Barahimi

We propose a novel probabilistic dimensionality reduction framework that can naturally integrate the generative model and the locality information of data. Based on this framework, we present a new model, which is able to learn a smooth…

Machine Learning · Statistics 2016-10-18 Li Wang

Deep neural networks (DNNs) on Riemannian manifolds have garnered increasing interest in various applied areas. For instance, DNNs on spherical and hyperbolic manifolds have been designed to solve a wide range of computer vision and nature…

Machine Learning · Statistics 2026-01-06 Xuan Son Nguyen , Shuo Yang , Aymeric Histace

Human face recognition has been a long standing problem in computer vision and pattern recognition. Facial analysis can be viewed as a two-fold problem, namely (i) facial representation, and (ii) classification. So far, many face…

Computer Vision and Pattern Recognition · Computer Science 2016-06-01 Mawloud Guermoui , Mohamed L. Mekhalfi

For an object classification system, the most critical obstacles towards real-world applications are often caused by large intra-class variability, arising from different lightings, occlusion and corruption, in limited sample sets. Most…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Homa Foroughi , Nilanjan Ray , Hong Zhang

Continual learning in large language models (LLMs) is prone to catastrophic forgetting, where adapting to new tasks significantly degrades performance on previously learned ones. Existing methods typically rely on low-rank,…

Most existing person re-identification (re-id) methods focus on learning the optimal distance metrics across camera views. Typically a person's appearance is represented using features of thousands of dimensions, whilst only hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2016-03-08 Li Zhang , Tao Xiang , Shaogang Gong