English
Related papers

Related papers: Intrinsic minimum average variance estimation for …

200 papers

This paper develops intrinsic wavelet denoising methods for surfaces of Hermitian positive definite matrices, with in mind the application to nonparametric estimation of the time-varying spectral matrix of a multivariate locally stationary…

Methodology · Statistics 2019-05-22 Joris Chau , Rainer von Sachs

We study the sublinear multivariate mean estimation problem in $d$-dimensional Euclidean space. Specifically, we aim to find the mean $\mu$ of a ground point set $A$, which minimizes the sum of squared Euclidean distances of the points in…

Data Structures and Algorithms · Computer Science 2025-10-07 Beatrice Bertolotti , Matteo Russo , Chris Schwiegelshohn , Sudarshan Shyam

The need for efficiently comparing and representing datasets with unknown alignment spans various fields, from model analysis and comparison in machine learning to trend discovery in collections of medical datasets. We use manifold learning…

Machine Learning · Statistics 2022-07-13 Tal Shnitzer , Mikhail Yurochkin , Kristjan Greenewald , Justin Solomon

Stochastic variance reduction algorithms have recently become popular for minimizing the average of a large, but finite, number of loss functions. In this paper, we propose a novel Riemannian extension of the Euclidean stochastic variance…

Machine Learning · Computer Science 2017-04-11 Hiroyuki Kasai , Hiroyuki Sato , Bamdev Mishra

In this paper, we propose a new global analysis framework for a class of low-rank matrix recovery problems on the Riemannian manifold. We analyze the global behavior for the Riemannian optimization with random initialization. We use the…

Machine Learning · Statistics 2021-04-20 Thomas Y. Hou , Zhenzhen Li , Ziyun Zhang

In this paper, we consider a class of nonconvex-linear minimax problems on Riemannian manifolds, which find wide applications in machine learning and signal processing. For solving this class of problems, we develop a flexible Riemannian…

Optimization and Control · Mathematics 2026-02-12 Meng Xu , Bo Jiang , Ya-Feng Liu , Anthony Man-Cho So

We consider the proximal gradient method on Riemannian manifolds for functions that are possibly not geodesically convex. Starting from the forward-backward-splitting, we define an intrinsic variant of the proximal gradient method that uses…

Optimization and Control · Mathematics 2025-06-12 Ronny Bergmann , Hajg Jasa , Paula John , Max Pfeffer

In this paper, we introduce the notion of generalized $\epsilon$-stationarity for a class of nonconvex and nonsmooth composite minimization problems on compact Riemannian submanifold embedded in Euclidean space. To find a generalized…

Optimization and Control · Mathematics 2023-10-31 Zheng Peng , Weihe Wu , Jiang Hu , Kangkang Deng

Most of the existing methods for estimating the local intrinsic dimension of a data distribution do not scale well to high-dimensional data. Many of them rely on a non-parametric nearest neighbors approach which suffers from the curse of…

Symmetric Positive Definite (SPD) matrices have received wide attention in machine learning due to their intrinsic capacity to encode underlying structural correlation in data. Many successful Riemannian metrics have been proposed to…

Machine Learning · Computer Science 2024-08-30 Ziheng Chen , Yue Song , Tianyang Xu , Zhiwu Huang , Xiao-Jun Wu , Nicu Sebe

Estimating intrinsic dimensionality of data is a classic problem in pattern recognition and statistics. Principal Component Analysis (PCA) is a powerful tool in discovering dimensionality of data sets with a linear structure; it, however,…

Computer Vision and Pattern Recognition · Computer Science 2010-02-11 Mingyu Fan , Nannan Gu , Hong Qiao , Bo Zhang

Non-Euclidean constraints are inherent in many kinds of data in computer vision and machine learning, typically as a result of specific invariance requirements that need to be respected during high-level inference. Often, these geometric…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Suhas Lohit , Pavan Turaga

Existing theories on deep nonparametric regression have shown that when the input data lie on a low-dimensional manifold, deep neural networks can adapt to the intrinsic data structures. In real world applications, such an assumption of…

Machine Learning · Computer Science 2023-06-27 Zixuan Zhang , Minshuo Chen , Mengdi Wang , Wenjing Liao , Tuo Zhao

The natural gradient method is widely used in statistical optimization, but its standard formulation assumes a Euclidean parameter space. This paper proposes an inversion-free stochastic natural gradient method for probability distributions…

Machine Learning · Statistics 2026-04-06 Dario Draca , Takuo Matsubara , Minh-Ngoc Tran

This study investigates the application of Riemannian geometry-based methods for brain decoding using invasive electrophysiological recordings. Although previously employed in non-invasive, the utility of Riemannian geometry for invasive…

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

Numerical Analysis · Mathematics 2020-12-01 Markus Hegland , Frank deHoog

We propose a rank-one Riemannian subspace descent algorithm for computing symmetric positive definite (SPD) solutions to nonlinear matrix equations arising in control theory, dynamic programming, and stochastic filtering. For solution…

Numerical Analysis · Mathematics 2026-01-22 Yogesh Darmwal , Ketan Rajawat

Muon and related norm-constrained matrix optimizers have become central to large-scale learning problems. They are formulated as a linear maximization oracle (LMO) over an ambient matrix-norm ball in unconstrained Euclidean space. However,…

Machine Learning · Computer Science 2026-05-12 Yibang Li , Bihari Lal Pandey , Ravi Sah , Andi Han , Cyrus Mostajeran , Pratik Jawanpuria , Bamdev Mishra

A Riemannian gradient descent algorithm and a truncated variant are presented to solve systems of phaseless equations $|Ax|^2=y$. The algorithms are developed by exploiting the inherent low rank structure of the problem based on the…

Numerical Analysis · Mathematics 2018-09-11 Jian-Feng Cai , Ke Wei

Correlation matrices are fundamental summaries of functional brain networks, yet standard analyses often treat entries independently, ignoring the curved geometry of correlation space. Existing geometric methods frequently lack closed-form…

Machine Learning · Computer Science 2026-05-22 Mario Severino , Manuela Moretto , Robert A. McCutcheon , Mattia Veronese