English
Related papers

Related papers: The Riemannian Langevin equation and conic program…

200 papers

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

We study the Riemannian Langevin Algorithm for the problem of sampling from a distribution with density $\nu$ with respect to the natural measure on a manifold with metric $g$. We assume that the target density satisfies a log-Sobolev…

Machine Learning · Computer Science 2022-04-25 Khashayar Gatmiry , Santosh S. Vempala

In this paper, we propose a Generalized Langevin Equation (GLE)-based model to describe the lateral diffusion of a protein in a lipid bilayer. The memory kernel is represented in terms of a viscous (instantaneous) and an elastic (non…

Biological Physics · Physics 2021-11-24 Loris Di Cairano , Benjamin Stamm , Vania Calandrini

Denoising diffusion models are a novel class of generative algorithms that achieve state-of-the-art performance across a range of domains, including image generation and text-to-image tasks. Building on this success, diffusion models have…

Machine Learning · Computer Science 2024-03-08 Nic Fishman , Leo Klarner , Valentin De Bortoli , Emile Mathieu , Michael Hutchinson

Brownian motion of free particles on curved surfaces is studied by means of the Langevin equation written in Riemann normal coordinates. In the diffusive regime we find the same physical behavior as the one described by the diffusion…

The Langevin equation is a common tool to model diffusion at a single-particle level. In non-homogeneous environments, such as aqueous two-phase systems or biological condensates with different diffusion coefficients in different phases,…

We examine a wide class of stochastic approximation algorithms for solving (stochastic) nonlinear problems on Riemannian manifolds. Such algorithms arise naturally in the study of Riemannian optimization, game theory and optimal transport,…

Optimization and Control · Mathematics 2022-12-29 Mohammad Reza Karimi , Ya-Ping Hsieh , Panayotis Mertikopoulos , Andreas Krause

We consider the classical problem of determining the stationary distribution of the semimartingale reflected Brownian motion (SRBM) in a two-dimensional wedge. Under standard assumptions on the parameters of the model (opening of the wedge,…

Probability · Mathematics 2025-01-31 M. Bousquet-Mélou , A. Elvey Price , S. Franceschi , C. Hardouin , K. Raschel

Manifold-valued measurements exist in numerous applications within computer vision and machine learning. Recent studies have extended Deep Neural Networks (DNNs) to manifolds, and concomitantly, normalization techniques have also been…

Machine Learning · Computer Science 2024-03-19 Ziheng Chen , Yue Song , Yunmei Liu , Nicu Sebe

A model has two main aims: predicting the behavior of a physical system and understanding its nature, that is how it works, at some desired level of abstraction. A promising recent approach to model building consists in deriving a…

Statistical Mechanics · Physics 2019-02-26 Marco Baldovin , Andrea Puglisi , Angelo Vulpiani

Equilibrium computation on Riemannian manifolds provides a unifying framework for numerous problems in machine learning and data analytics. One of the simplest yet most fundamental methods is Riemannian gradient descent (RGD). While its…

Optimization and Control · Mathematics 2025-11-11 Yang Cai , Michael I. Jordan , Tianyi Lin , Argyris Oikonomou , Emmanouil-Vasileios Vlatakis-Gkaragkounis

The covariant form of the multivariable diffusion-drift process is described by the covariant Fokker--Planck equation using the standard toolbox of Riemann geometry. The covariant form of the equivalent Langevin stochastic differential…

Statistical Mechanics · Physics 2024-10-24 Lajos Diósi

Two different versions of relativistic Langevin equation in curved spacetime background are constructed, both are manifestly general covariant. It is argued that, from the observer's point of view, the version which takes the proper time of…

Statistical Mechanics · Physics 2023-11-28 Yifan Cai , Tao Wang , Liu Zhao

Sampling is a fundamental and arguably very important task with numerous applications in Machine Learning. One approach to sample from a high dimensional distribution $e^{-f}$ for some function $f$ is the Langevin Algorithm (LA). Recently,…

Machine Learning · Computer Science 2020-12-08 Xiao Wang , Qi Lei , Ioannis Panageas

We propose a method for efficiently incorporating constraints into a stochastic gradient Langevin framework for the training of deep neural networks. Constraints allow direct control of the parameter space of the model. Appropriately…

Machine Learning · Computer Science 2021-06-22 Benedict Leimkuhler , Timothée Pouchon , Tiffany Vlaar , Amos Storkey

Recurrent neural networks are powerful models for sequential data, able to represent complex dependencies in the sequence that simpler models such as hidden Markov models cannot handle. Yet they are notoriously hard to train. Here we…

Neural and Evolutionary Computing · Computer Science 2015-02-04 Yann Ollivier

Many scientific and geometric problems exhibit general linear symmetries, yet most equivariant neural networks are built for compact groups or simple vector features, limiting their reuse on matrix-valued data such as covariances, inertias,…

Machine Learning · Computer Science 2026-02-02 Chankyo Kim , Sicheng Zhao , Minghan Zhu , Tzu-Yuan Lin , Maani Ghaffari

The coinvariant algebra $R_n$ is a well-studied $\mathfrak{S}_n$-module that is a graded version of the regular representation of $\mathfrak{S}_n$. Using a straightening algorithm on monomials and the Garsia-Stanton basis, Adin, Brenti, and…

Combinatorics · Mathematics 2018-02-26 Kyle P. Meyer

Stochastic variance reduction algorithms have recently become popular for minimizing the average of a large, but finite, number of loss functions. In this paper, we propose a novel Riemannian extension of the Euclidean stochastic variance…

Machine Learning · Computer Science 2017-04-11 Hiroyuki Kasai , Hiroyuki Sato , Bamdev Mishra

We study regularization for the deep linear network (DLN) using the entropy formula introduced in arXiv:2509.09088. The equilibria and gradient flow of the free energy on the Riemannian manifold of end-to-end maps of the DLN are…

Neural and Evolutionary Computing · Computer Science 2025-12-09 Alan Chen , Tejas Kotwal , Govind Menon