English
Related papers

Related papers: Normalizing Flows on Riemannian Manifolds

200 papers

Normalizing flows are a class of machine learning models used to construct a complex distribution through a bijective mapping of a simple base distribution. We demonstrate that normalizing flows are particularly well suited as a Monte Carlo…

Nuclear Theory · Physics 2021-08-11 Jack Brady , Pengsheng Wen , Jeremy W. Holt

Normalizing Flows (NFs) are powerful and efficient models for density estimation. When modeling densities on manifolds, NFs can be generalized to injective flows but the Jacobian determinant becomes computationally prohibitive. Current…

Machine Learning · Computer Science 2025-01-27 Marcello Massimo Negri , Jonathan Aellen , Volker Roth

The multivariate normal density is a monotonic function of the distance to the mean, and its ellipsoidal shape is due to the underlying Euclidean metric. We suggest to replace this metric with a locally adaptive, smoothly changing…

Machine Learning · Statistics 2016-09-26 Georgios Arvanitidis , Lars Kai Hansen , Søren Hauberg

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow, thus allowing maps…

Machine Learning · Computer Science 2022-11-07 Samuel Klein , John Andrew Raine , Tobias Golling

We consider optimization problems on manifolds with equality and inequality constraints. A large body of work treats constrained optimization in Euclidean spaces. In this work, we consider extensions of existing algorithms from the…

Optimization and Control · Mathematics 2019-04-26 Changshuo Liu , Nicolas Boumal

Inspired by the idea of Colding-Minicozzi in [CM1], we define (mean curvature flow) entropy for submanifolds in a general ambient Riemannian manifold. In particular, this entropy is equivalent to area growth of a closed submanifold in a…

Differential Geometry · Mathematics 2020-08-04 Ao Sun

Efficient gradient computation of the Jacobian determinant term is a core problem in many machine learning settings, and especially so in the normalizing flow framework. Most proposed flow models therefore either restrict to a function…

Machine Learning · Computer Science 2021-06-10 T. Anderson Keller , Jorn W. T. Peters , Priyank Jaini , Emiel Hoogeboom , Patrick Forré , Max Welling

An increasingly common viewpoint is that protein dynamics data sets reside in a non-linear subspace of low conformational energy. Ideal data analysis tools for such data sets should therefore account for such non-linear geometry. The…

Biomolecules · Quantitative Biology 2023-10-27 Willem Diepeveen , Carlos Esteve-Yagüe , Jan Lellmann , Ozan Öktem , Carola-Bibiane Schönlieb

The geometric approach to optimal transport and information theory has triggered the interpretation of probability densities as an infinite-dimensional Riemannian manifold. The most studied Riemannian structures are Otto's metric, yielding…

Analysis of PDEs · Mathematics 2018-07-20 Martin Bauer , Sarang Joshi , Klas Modin

The Gaussian kernel and its traditional normalizations (e.g., row-stochastic) are popular approaches for assessing similarities between data points. Yet, they can be inaccurate under high-dimensional noise, especially if the noise magnitude…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Xiuyuan Cheng

We introduce a novel geometric approach to the image labeling problem. Abstracting from specific labeling applications, a general objective function is defined on a manifold of stochastic matrices, whose elements assign prior data that are…

Computer Vision and Pattern Recognition · Computer Science 2017-01-16 Freddie Åström , Stefania Petra , Bernhard Schmitzer , Christoph Schnörr

We consider density estimators based on the nearest neighbors method applied to discrete point distibutions in spaces of arbitrary dimensionality. If the density is constant, the volume of a hypersphere centered at a random location is…

Instrumentation and Methods for Astrophysics · Physics 2013-01-24 Przemek Wozniak , Andrzej Kruszewski

Flow-based generative models are composed of invertible transformations between two random variables of the same dimension. Therefore, flow-based models cannot be adequately trained if the dimension of the data distribution does not match…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Hyeongju Kim , Hyeonseung Lee , Woo Hyun Kang , Joun Yeop Lee , Nam Soo Kim

It is often of interest to infer lower-dimensional structure underlying complex data. As a flexible class of non-linear structures, it is common to focus on Riemannian manifolds. Most existing manifold learning algorithms replace the…

Machine Learning · Statistics 2026-01-27 David B Dunson , Nan Wu

In this paper, we propose RiemannianFlow, a deep generative model that allows robots to learn complex and stable skills evolving on Riemannian manifolds. Examples of Riemannian data in robotics include stiffness (symmetric and positive…

Robotics · Computer Science 2023-09-27 Weitao Wang , Matteo Saveriano , Fares J. Abu-Dakka

We introduce the manifold density function, which is an intrinsic method to validate manifold learning techniques. Our approach adapts and extends Ripley's $K$-function, and categorizes in an unsupervised setting the extent to which an…

Machine Learning · Computer Science 2024-02-16 Benjamin Holmgren , Eli Quist , Jordan Schupbach , Brittany Terese Fasy , Bastian Rieck

Normalizing flows leverage the Change of Variables Formula (CVF) to define flexible density models. Yet, the requirement of smooth transformations (diffeomorphisms) in the CVF poses a significant challenge in the construction of these…

Machine Learning · Statistics 2021-07-12 Niklas Koenen , Marvin N. Wright , Peter Maaß , Jens Behrmann

Normalizing Flows are generative models that directly maximize the likelihood. Previously, the design of normalizing flows was largely constrained by the need for analytical invertibility. We overcome this constraint by a training procedure…

Machine Learning · Computer Science 2024-04-25 Felix Draxler , Peter Sorrenson , Lea Zimmermann , Armand Rousselot , Ullrich Köthe

We discuss pseudo-Riemannian metrics on 2-dimensional manifolds such that the geodesic flow admits a nontrivial integral quadratic in velocities. We construct local normal forms of such metrics. We show that these metrics have certain…

Mathematical Physics · Physics 2015-05-13 Alexey V. Bolsinov , Vladimir S. Matveev , Giuseppe Pucacco

Testing procedures for assessing specific parametric model forms, or for checking the plausibility of simplifying assumptions, play a central role in the mathematical treatment of the uncertain. No certain answers are obtained by testing…