English
Related papers

Related papers: Dynamic Elliptical Graph Factor Models via Riemann…

200 papers

We propose a dynamic factor model (DFM) where the latent factors are linked to observed variables with unknown and potentially nonlinear functions. The key novelty and source of flexibility of our approach is a nonparametric observation…

Econometrics · Economics 2025-09-08 Tony Chernis , Niko Hauzenberger , Haroon Mumtaz , Michael Pfarrhofer

Adaptive stochastic gradient algorithms in the Euclidean space have attracted much attention lately. Such explorations on Riemannian manifolds, on the other hand, are relatively new, limited, and challenging. This is because of the…

Machine Learning · Computer Science 2019-07-01 Hiroyuki Kasai , Pratik Jawanpuria , Bamdev Mishra

We study a type of Riemannian gradient descent (RGD) algorithm, designed through Riemannian preconditioning, for optimization on $\mathcal{M}_k^{m\times n}$ -- the set of $m\times n$ real matrices with a fixed rank $k$. Our analysis is…

Optimization and Control · Mathematics 2024-08-15 Shuyu Dong , Bin Gao , Wen Huang , Kyle A. Gallivan

This paper studies large-scale optimization problems on Riemannian manifolds whose objective function is a finite sum of negative log-probability losses. Such problems arise in various machine learning and signal processing applications. By…

Optimization and Control · Mathematics 2022-07-18 Jiang Hu , Ruicheng Ao , Anthony Man-Cho So , Minghan Yang , Zaiwen Wen

Modeling non-Euclidean data is drawing extensive attention along with the unprecedented successes of deep neural networks in diverse fields. Particularly, a symmetric positive definite matrix is being actively studied in computer vision,…

Machine Learning · Computer Science 2023-10-09 Seungwoo Jeong , Wonjun Ko , Ahmad Wisnu Mulyadi , Heung-Il Suk

We propose an inexact optimization algorithm on Riemannian manifolds, motivated by quadratic discrimination tasks in high-dimensional, low-sample-size (HDLSS) imaging settings. In such applications, gradient evaluations are often biased due…

Optimization and Control · Mathematics 2025-07-08 Uday Talwar , Meredith K. Kupinski , Afrooz Jalilzadeh

With 6G evolving towards intelligent network autonomy, artificial intelligence (AI)-native operations are becoming pivotal. Wireless networks continuously generate rich and heterogeneous data, which inherently exhibits spatio-temporal graph…

Signal Processing · Electrical Eng. & Systems 2026-04-09 Zhonghao Jiu , Yongming Huang , Fan Meng , Hang Zhan , Zening Liu , Xiaohu You

Most of real-world graphs are dynamic, i.e., they change over time by a sequence of update operations. While the regression problem has been studied for static graphs and temporal graphs, it is not investigated for general dynamic graphs.…

Machine Learning · Computer Science 2022-10-10 Mostafa Haghir Chehreghani

We develop a new Riemannian descent algorithm that relies on momentum to improve over existing first-order methods for geodesically convex optimization. In contrast, accelerated convergence rates proved in prior work have only been shown to…

Optimization and Control · Mathematics 2021-02-16 Foivos Alimisis , Antonio Orvieto , Gary Bécigneul , Aurelien Lucchi

From optimal transport to robust dimensionality reduction, a plethora of machine learning applications can be cast into the min-max optimization problems over Riemannian manifolds. Though many min-max algorithms have been analyzed in the…

Optimization and Control · Mathematics 2022-09-29 Michael I. Jordan , Tianyi Lin , Emmanouil-Vasileios Vlatakis-Gkaragkounis

In this paper the space of images is considered as a Riemannian manifold using the metamorphosis approach, where the underlying Riemannian metric simultaneously measures the cost of image transport and intensity variation. A robust and…

Numerical Analysis · Mathematics 2015-05-28 Benjamin Berkels , Alexander Effland , Martin Rumpf

Graphs are typical non-Euclidean data of complex structures. In recent years, Riemannian graph representation learning has emerged as an exciting alternative to Euclidean ones. However, Riemannian methods are still in an early stage: most…

Machine Learning · Computer Science 2024-01-03 Li Sun , Zhenhao Huang , Zixi Wang , Feiyang Wang , Hao Peng , Philip Yu

This paper presents a novel factor graph-based approach to solve the discrete-time finite-horizon Linear Quadratic Regulator problem subject to auxiliary linear equality constraints within and across time steps. We represent such optimal…

Robotics · Computer Science 2021-10-27 Shuo Yang , Gerry Chen , Yetong Zhang , Howie Choset , Frank Dellaert

An increasingly common viewpoint is that protein dynamics data sets reside in a non-linear subspace of low conformational energy. Ideal data analysis tools for such data sets should therefore account for such non-linear geometry. The…

Biomolecules · Quantitative Biology 2023-10-27 Willem Diepeveen , Carlos Esteve-Yagüe , Jan Lellmann , Ozan Öktem , Carola-Bibiane Schönlieb

It has been observed in a variety of contexts that gradient descent methods have great success in solving low-rank matrix factorization problems, despite the relevant problem formulation being non-convex. We tackle a particular instance of…

Numerical Analysis · Computer Science 2016-06-28 Dejiao Zhang , Laura Balzano

In this paper, the Riemannian gradient algorithm and the natural gradient algorithm are applied to solve descent direction problems on the manifold of positive definite Hermitian matrices, where the geodesic distance is considered as the…

Optimization and Control · Mathematics 2021-06-01 Xiaomin Duan , Huafei Sun , Linyu Peng

The last decade has witnessed an explosion in the development of models, theory and computational algorithms for "big data" analysis. In particular, distributed computing has served as a natural and dominating paradigm for statistical…

Machine Learning · Statistics 2018-11-02 Bayan Saparbayeva , Michael Minyi Zhang , Lizhen Lin

Random geometric graphs are random graph models defined on metric measure spaces. A random geometric graph is generated by first sampling points from a metric space and then connecting each pair of sampled points independently with a…

Probability · Mathematics 2025-11-10 Han Huang , Pakawut Jiradilok , Elchanan Mossel

We develop an accelerated gradient descent algorithm on the Grassmann manifold to compute the subspace spanned by a number of leading eigenvectors of a symmetric positive semi-definite matrix. This has a constant cost per iteration and a…

Optimization and Control · Mathematics 2024-06-27 Foivos Alimisis , Simon Vary , Bart Vandereycken

This work puts forth low-complexity Riemannian subspace descent algorithms for the minimization of functions over the symmetric positive definite (SPD) manifold. Different from the existing Riemannian gradient descent variants, the proposed…

Machine Learning · Statistics 2023-12-19 Yogesh Darmwal , Ketan Rajawat