English
Related papers

Related papers: Total Variation Rates for Riemannian Flow Matching

200 papers

Total Variation (TV) is a popular regularization strategy that promotes piece-wise constant signals by constraining the $\ell_1$-norm of the first order derivative of the estimated signal. The resulting optimization problem is usually…

Optimization and Control · Mathematics 2020-10-20 Hamza Cherkaoui , Jeremias Sulam , Thomas Moreau

We propose Manifold Free-Form Flows (M-FFF), a simple new generative model for data on manifolds. The existing approaches to learning a distribution on arbitrary manifolds are expensive at inference time, since sampling requires solving a…

Machine Learning · Computer Science 2024-11-26 Peter Sorrenson , Felix Draxler , Armand Rousselot , Sander Hummerich , Ullrich Köthe

Matching objectives underpin the success of modern generative models and rely on constructing conditional paths that transform a source distribution into a target distribution. Despite being a fundamental building block, conditional paths…

We propose Pullback Flow Matching (PFM), a novel framework for generative modeling on data manifolds. Unlike existing methods that assume or learn restrictive closed-form manifold mappings for training Riemannian Flow Matching (RFM) models,…

Machine Learning · Computer Science 2025-07-10 Friso de Kruiff , Erik Bekkers , Ozan Öktem , Carola-Bibiane Schönlieb , Willem Diepeveen

In this paper, we propose a new numerical scheme for a spatially discrete model of constrained total variation flows, which are total variation flows whose values are constrained in a Riemannian manifold. The difficulty of this problem is…

Analysis of PDEs · Mathematics 2020-05-05 Yoshikazu Giga , Koya Sakakibara , Kazutoshi Taguchi , Masaaki Uesaka

Modern generative modeling methods have demonstrated strong performance in learning complex data distributions from clean samples. In many scientific and imaging applications, however, clean samples are unavailable, and only noisy or…

Machine Learning · Computer Science 2026-05-29 Willem Diepeveen , Oscar Leong

Even after over two decades, the total variation (TV) remains one of the most popular regularizations for image processing problems and has sparked a tremendous amount of research, particularly to move from scalar to vector-valued…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Joan Duran , Michael Moeller , Catalina Sbert , Daniel Cremers

Vision-Language Models (VLMs) are typically deterministic in nature and lack intrinsic mechanisms to quantify epistemic uncertainty, which reflects the model's lack of knowledge or ignorance of its own representations. We theoretically…

Machine Learning · Computer Science 2026-05-21 Li Ju , Mayank Nautiyal , Andreas Hellander , Ekta Vats , Prashant Singh

Training deep neural networks remains computationally intensive due to the itera2 tive nature of gradient-based optimization. We propose Gradient Flow Matching (GFM), a continuous-time modeling framework that treats neural network training…

Machine Learning · Computer Science 2025-05-27 Xiao Shou , Yanna Ding , Jianxi Gao

We consider the functional of total variation of maps from an interval into a Riemannian submanifold of $\mathbb R^N$. We define a notion of strong solution to the system of equations corresponding to the $L^2$-gradient flow of this…

Analysis of PDEs · Mathematics 2025-11-12 Lorenzo Giacomelli , Michał Łasica , Salvador Moll

A generalized additive model (GAM, Hastie and Tibshirani (1987)) is a nonparametric model by the sum of univariate functions with respect to each explanatory variable, i.e., $f({\mathbf x}) = \sum f_j(x_j)$, where $x_j\in\mathbb{R}$ is…

Machine Learning · Statistics 2018-02-19 Shin Matsushima

We are interested in learning generative models for complex geometries described via manifolds, such as spheres, tori, and other implicit surfaces. Current extensions of existing (Euclidean) generative models are restricted to specific…

Machine Learning · Statistics 2021-11-04 Noam Rozen , Aditya Grover , Maximilian Nickel , Yaron Lipman

Recent flow matching (FM) methods improve the few-shot adaptation of vision-language models, by modeling cross-modal alignment as a continuous multi-step flow. In this paper, we argue that existing FM methods are inherently constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Hongxu Chen , Yanghao Wang , Bowei Zhu , Hongxiang Li , Zhen Wang , Ziqi Jiang , Lin Li , Rui Liu , Long Chen

We consider the problem of density estimation on Riemannian manifolds. Density estimation on manifolds has many applications in fluid-mechanics, optics and plasma physics and it appears often when dealing with angular variables (such as…

Machine Learning · Statistics 2016-11-10 Mevlana C. Gemici , Danilo Rezende , Shakir Mohamed

In this paper, we formulate the Load Flow (LF) problem in radial electricity distribution networks as an unconstrained Riemannian optimization problem, consisting of two manifolds, and we consider alternative retractions and initialization…

Optimization and Control · Mathematics 2020-04-09 M. Heidarifar , P. Andrianesis , M. C. Caramanis

Normalizing flows have shown great promise for modelling flexible probability distributions in a computationally tractable way. However, whilst data is often naturally described on Riemannian manifolds such as spheres, torii, and hyperbolic…

Machine Learning · Statistics 2020-12-10 Emile Mathieu , Maximilian Nickel

We introduce a (de)-regularization of the Maximum Mean Discrepancy (DrMMD) and its Wasserstein gradient flow. Existing gradient flows that transport samples from source distribution to target distribution with only target samples, either…

Over the last 30 years a plethora of variational regularisation models for image reconstruction has been proposed and thoroughly inspected by the applied mathematics community. Among them, the pioneering prototype often taught and learned…

Numerical Analysis · Mathematics 2021-04-09 Monica Pragliola , Luca Calatroni , Alessandro Lanza , Fiorella Sgallari

We give quantitative estimates for the rate of convergence of Riemannian stochastic gradient descent (RSGD) to Riemannian gradient flow and to a diffusion process, the so-called Riemannian stochastic modified flow (RSMF). Using tools from…

Machine Learning · Computer Science 2025-03-10 Benjamin Gess , Sebastian Kassing , Nimit Rana

Our results concern geometry of a manifold endowed with a pair of complementary orthogonal distributions (plane fields) and a time-dependent Riemannian metric. The work begins with formulae concerning deformations of geometric quantities as…

Differential Geometry · Mathematics 2015-12-31 Vladimir Rovenski , Robert Wolak