English
Related papers

Related papers: Spectral Flow on the Manifold of SPD Matrices for …

200 papers

Off-the-shelf Gaussian Process (GP) covariance functions encode smoothness assumptions on the structure of the function to be modeled. To model complex and non-differentiable functions, these smoothness assumptions are often too…

Machine Learning · Statistics 2016-04-12 Roberto Calandra , Jan Peters , Carl Edward Rasmussen , Marc Peter Deisenroth

In a mixed generalized linear model, the goal is to learn multiple signals from unlabeled observations: each sample comes from exactly one signal, but it is not known which one. We consider the prototypical problem of estimating two…

Statistics Theory · Mathematics 2026-01-12 Yihan Zhang , Marco Mondelli , Ramji Venkataramanan

Motion planning with constraints is an important part of many real-world robotic systems. In this work, we study manifold learning methods to learn such constraints from data. We explore two methods for learning implicit constraint…

Neural models learn representations of high-dimensional data on low-dimensional manifolds. Multiple factors, including stochasticities in the training process, model architectures, and additional inductive biases, may induce different…

Machine Learning · Computer Science 2025-12-02 Hanlin Yu , Berfin Inal , Georgios Arvanitidis , Soren Hauberg , Francesco Locatello , Marco Fumero

Flow-based models typically define a latent space with dimensionality identical to the observational space. In many problems, however, the data does not populate the full ambient data space that they natively reside in, rather inhabiting a…

Machine Learning · Statistics 2023-02-24 Mingtian Zhang , Yitong Sun , Chen Zhang , Steven McDonagh

Positive semidefinite (PSD) matrices are indispensable in many fields of science. A similarity measurement for such matrices is usually an essential ingredient in the mathematical modelling of a scientific problem. This paper proposes a…

Numerical Analysis · Mathematics 2023-12-22 Peng Liu , Ke Ye

Dimensionality reduction is a fundamental task that aims to simplify complex data by reducing its feature dimensionality while preserving essential patterns, with core applications in data analysis and visualisation. To preserve the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Thomas Dagès , Simon Weber , Ya-Wei Eileen Lin , Ronen Talmon , Daniel Cremers , Michael Lindenbaum , Alfred M. Bruckstein , Ron Kimmel

Many machine learning tasks, such as principal component analysis and low-rank matrix completion, give rise to manifold optimization problems. Although there is a large body of work studying the design and analysis of algorithms for…

Machine Learning · Computer Science 2024-06-13 Jiaojiao Zhang , Jiang Hu , Anthony Man-Cho So , Mikael Johansson

Guided wave-based structural health monitoring (SHM) remains a powerful strategy for identifying early-stage defects and safeguarding vital aerospace structures. Yet, its practical use is often hindered by the enormous, high-dimensional…

Signal Processing · Electrical Eng. & Systems 2025-04-16 Yiming Fan , Dimitris G Giovanis , Fotis Kopsaftopoulos

Four-dimensional scanning transmission electron microscopy (4D-STEM) of local atomic diffraction patterns is emerging as a powerful technique for probing intricate details of atomic structure and atomic electric fields. However, efficient…

Image and Video Processing · Electrical Eng. & Systems 2019-01-15 Xin Li , Ondrej E. Dyck , Mark P. Oxley , Andrew R. Lupini , Leland McInnes , John Healy , Stephen Jesse , Sergei V. Kalinin

This survey is written in summer, 2016. The purpose of this survey is to briefly introduce nonlinear dimensionality reduction (NLDR) in data reduction. The first two NLDR were respectively published in Science in 2000 in which they solve…

Machine Learning · Computer Science 2022-03-22 Ce Ju

Research in modern data-driven dynamical systems is typically focused on the three key challenges of high dimensionality, unknown dynamics, and nonlinearity. The dynamic mode decomposition (DMD) has emerged as a cornerstone for modeling…

Fluid Dynamics · Physics 2022-04-27 Peter J. Baddoo , Benjamin Herrmann , Beverley J. McKeon , Steven L. Brunton

This paper investigates the formulation and implementation of Bayesian inverse problems to learn input parameters of partial differential equations (PDEs) defined on manifolds. Specifically, we study the inverse problem of determining the…

Numerical Analysis · Mathematics 2019-10-24 John Harlim , Daniel Sanz-Alonso , Ruiyi Yang

Flow Matching enables simulation-free training of generative models on Riemannian manifolds, yet sampling typically still relies on numerically integrating a probability-flow ODE. We propose Riemannian MeanFlow (RMF), extending MeanFlow to…

Machine Learning · Computer Science 2026-05-21 Zichen Zhong , Haoliang Sun , Yukun Zhao , Yongshun Gong , Yilong Yin

While the existence of low-dimensional embedding manifolds has been shown in patterns of collective motion, the current battery of nonlinear dimensionality reduction methods are not amenable to the analysis of such manifolds. This is mainly…

Numerical Analysis · Mathematics 2017-07-21 Kelum Gajamannage , Sachit Butail , Maurizio Porfiri , Erik M. Bollt

Despite high-dimensionality of images, the sets of images of 3D objects have long been hypothesized to form low-dimensional manifolds. What is the nature of such manifolds? How do they differ across objects and object classes? Answering…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Benjamin Beaudett , Shenyuan Liang , Anuj Srivastava

In this paper, we aim at tackling a general but interesting cross-modality feature learning question in remote sensing community --- can a limited amount of highly-discrimin-ative (e.g., hyperspectral) training data improve the performance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Danfeng Hong , Naoto Yokoya , Nan Ge , Jocelyn Chanussot , Xiao Xiang Zhu

A primary spectral submanifold (SSM) is the unique smoothest nonlinear continuation of a nonresonant spectral subspace $E$ of a dynamical system linearized at a fixed point. Passing from the full nonlinear dynamics to the flow on an…

Dynamical Systems · Mathematics 2023-06-28 George Haller , Bálint Kaszás , Aihui Liu , Joar Axås

Spectral dimensionality reduction algorithms are widely used in numerous domains, including for recognition, segmentation, tracking and visualization. However, despite their popularity, these algorithms suffer from a major limitation known…

Machine Learning · Computer Science 2018-01-03 Yochai Blau , Tomer Michaeli

The existing research on spectral algorithms, applied within a Reproducing Kernel Hilbert Space (RKHS), has primarily focused on general kernel functions, often neglecting the inherent structure of the input feature space. Our paper…

Machine Learning · Statistics 2024-03-08 Weichun Xia , Lei Shi