English
Related papers

Related papers: Stochastic optimization on matrices and a graphon …

200 papers

We establish the O($\frac{1}{k}$) convergence rate for distributed stochastic gradient methods that operate over strongly convex costs and random networks. The considered class of methods is standard each node performs a weighted average of…

Optimization and Control · Mathematics 2018-03-22 Dusan Jakovetic , Dragana Bajovic , Anit Kumar Sahu , Soummya Kar

This paper focus on investigating the explicit rate of convergence for the propagation of chaos, in a pathwise sense a family of interacting stochastic particle related to some Brownian driven McKean-Vlasov dynamics. Precisely the McKean…

Probability · Mathematics 2019-07-23 Jean-Francois Jabir

For addressing optimisation tasks on finite dimensional quantum systems, we give a comprehensive account of the foundations of gradient flows on Riemannian manifolds including new developments: we extend former results from Lie groups such…

Quantum Physics · Physics 2010-12-07 T. Schulte-Herbrueggen , S. J. Glaser , G. Dirr , U. Helmke

We study the fluctuation behavior of individual eigenvalues of kernel matrices arising from dense graphon-based random graphs. Under minimal integrability and boundedness assumptions on the graphon, we establish distributional limits for…

Probability · Mathematics 2026-03-03 Behzad Aalipur

Exchangeable random graphs, which include some of the most widely studied network models, have emerged as the mainstay of statistical network analysis in recent years. Graphons, which are the central objects in graph limit theory, provide a…

Statistics Theory · Mathematics 2024-09-17 Anirban Chatterjee , Soham Dan , Bhaswar B. Bhattacharya

In this work, we show that a family of non-linear mean-field equations on discrete spaces can be viewed as a gradient flow of a natural free energy functional with respect to a certain metric structure we make explicit. We also prove that…

Probability · Mathematics 2016-10-26 Matthias Erbar , Max Fathi , Vaios Laschos , André Schlichting

Multiplicative noise makes stochastic dynamics depend on how the white-noise limit is interpreted. In multidimensional systems with matrix-valued noise amplitudes $\sigma(x)$, this dependence includes a local Jacobian contribution that is…

Statistical Mechanics · Physics 2026-05-14 Surachate Limkumnerd

We study stochastic convex optimization under infinite noise variance. Specifically, when the stochastic gradient is unbiased and has uniformly bounded $(1+\kappa)$-th moment, for some $\kappa \in (0,1]$, we quantify the convergence rate of…

Machine Learning · Statistics 2022-02-24 Nuri Mert Vural , Lu Yu , Krishnakumar Balasubramanian , Stanislav Volgushev , Murat A. Erdogdu

We establish the existence of solutions to common noise McKean-Vlasov martingale problems for coefficients with low regularity. Our approach is able to handle the key challenge posed by drift coefficients that are discontinuous with respect…

Probability · Mathematics 2025-09-01 Robert Alexander Crowell

Matrix differential Riccati equations are central in filtering and optimal control theory. The purpose of this article is to develop a perturbation theory for a class of stochastic matrix Riccati diffusions. Diffusions of this type arise,…

Probability · Mathematics 2021-10-04 Adrian N. Bishop , Pierre Del Moral , Angele Niclas

Large ensembles of stochastically evolving interacting particles describe phenomena in diverse fields including statistical physics, neuroscience, biology, and engineering. In such systems, the infinitesimal evolution of each particle…

Probability · Mathematics 2024-01-02 Kavita Ramanan

Modern supervised learning techniques, particularly those using deep nets, involve fitting high dimensional labelled data sets with functions containing very large numbers of parameters. Much of this work is empirical. Interesting phenomena…

Machine Learning · Statistics 2018-05-30 Partha P Mitra

Motivated by the occurrence in rate functions of time-dependent large-deviation principles, we study a class of non-negative functions $\mathscr L$ that induce a flow, given by $\mathscr L(\rho_t,\dot\rho_t)=0$. We derive necessary and…

Functional Analysis · Mathematics 2018-01-17 Alexander Mielke , D. R. Michiel Renger , Mark A. Peletier

Gradient flow in the 2-Wasserstein space is widely used to optimize functionals over probability distributions and is typically implemented using an interacting particle system with $n$ particles. Analyzing these algorithms requires showing…

Machine Learning · Computer Science 2026-03-27 Chandan Tankala , Dheeraj M. Nagaraj , Anant Raj

We consider a mean-field system of path-dependent stochastic interacting diffusions in random media over a finite time window. The interaction term is given as a function of the empirical measure and is allowed to be non-linear and path…

Probability · Mathematics 2022-03-03 Rangel Baldasso , Alan Pereira , Guilherme Reis

The normalised partial sums of values of a nonnegative multiplicative function over divisors with appropriately restricted sizes of a random permutation from the symmetric group define trajectories of a stochastic process. We prove a…

Probability · Mathematics 2026-01-14 Eugenijus Manstavičius

We introduce order-based diffusion processes as the solutions to multidimensional stochastic differential equations, with drift coefficient depending only on the ordering of the coordinates of the process and diffusion matrix proportional…

Probability · Mathematics 2014-03-11 Benjamin Jourdain , Julien Reygner

Directed and undirected graphical models, also called Bayesian networks and Markov random fields, respectively, are important statistical tools in a wide variety of fields, ranging from computational biology to probabilistic artificial…

Combinatorics · Mathematics 2007-06-13 Sergi Elizalde , Kevin Woods

We define a new family of similarity and distance measures on graphs, and explore their theoretical properties in comparison to conventional distance metrics. These measures are defined by the solution(s) to an optimization problem which…

Machine Learning · Computer Science 2019-09-11 C. B. Scott , Eric Mjolsness

Power grids are undergoing major changes from a few large producers to smart grids build upon renewable energies. Mathematical models for power grid dynamics have to be adapted to capture, when dynamic nodes can achieve synchronization to a…

Dynamical Systems · Mathematics 2018-07-11 Christian Kuehn , Sebastian Throm