English
Related papers

Related papers: The gradient flow coupling from numerical stochast…

200 papers

We present an effective numerical procedure, which is based on the computational scheme from [Heid et al., arXiv:1906.06954], for the numerical approximation of excited states of Schr\"odingers equation. In particular, this procedure…

Numerical Analysis · Mathematics 2021-09-16 Pascal Heid

We consider stochastic gradient estimation using only black-box function evaluations, where the function argument lies within a probability simplex. This problem is motivated from gradient-descent optimization procedures in multiple…

Optimization and Control · Mathematics 2021-05-20 Henry Lam , Junhui Zhang

Sampling a target probability distribution with an unknown normalization constant is a fundamental challenge in computational science and engineering. Recent work shows that algorithms derived by considering gradient flows in the space of…

Machine Learning · Statistics 2024-03-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M Stuart

It is well-known that linearized perturbation methods for sensitivity analysis, such as tangent or adjoint equation-based, finite difference and automatic differentiation are not suitable for turbulent flows. The reason is that turbulent…

Chaotic Dynamics · Physics 2019-07-04 Nisha Chandramoorthy , Qiqi Wang

This paper considers the problem of designing a continuous-time dynamical system that solves a constrained nonlinear optimization problem and makes the feasible set forward invariant and asymptotically stable. The invariance of the feasible…

Optimization and Control · Mathematics 2024-08-27 Ahmed Allibhoy , Jorge Cortés

The purpose of the present work is to expand substantially the type of control and estimation problems that can be addressed following the paradigm of Schr\"odinger bridges, by incorporating termination (killing) of stochastic flows.…

Optimization and Control · Mathematics 2024-06-24 Asmaa Eldesoukey , Olga Movilla Miangolarra , Tryphon T. Georgiou

Accurate and efficient prediction of multi-scale flows remains a formidable challenge. Constructing theoretical models and numerical methods often involves the design and optimization of parameters. While gradient descent methods have been…

Computational Physics · Physics 2026-02-10 Tianbai Xiao

We propose a mathematically principled PDE gradient flow framework for distributionally robust optimization (DRO). Exploiting the recent advances in the intersection of Markov Chain Monte Carlo sampling and gradient flow theory, we show…

Optimization and Control · Mathematics 2026-05-27 Zusen Xu , Jia-Jie Zhu

Sampling a probability distribution with an unknown normalization constant is a fundamental problem in computational science and engineering. This task may be cast as an optimization problem over all probability measures, and an initial…

Machine Learning · Statistics 2024-09-12 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

We consider in this work small random perturbations (of multiplicative noise type) of the gradient flow. We prove that under mild conditions, when the potential function is a Morse function with additional strong saddle condition, the…

Probability · Mathematics 2020-04-29 Jiaojiao Yang , Wenqing Hu , Chris Junchi Li

In this article, we discuss gradient robust discretizations for the simulation of non-linear incompressible Navier-Stokes problem and the optimal control of such flow. We consider several formulations of the flow problem that are equivalent…

Optimization and Control · Mathematics 2026-03-13 Constanze Neutsch , Winnifried Wollner

This paper studies stochastic control problems with the action space taken to be probability measures, with the objective penalised by the relative entropy. We identify suitable metric space on which we construct a gradient flow for the…

Optimization and Control · Mathematics 2024-01-26 David Šiška , Łukasz Szpruch

Despite the widespread use of gradient-based algorithms for optimizing high-dimensional non-convex functions, understanding their ability of finding good minima instead of being trapped in spurious ones remains to a large extent an open…

The article discusses the gradient discretisation method (GDM) for distributed optimal control problems governed by diffusion equation with pure Neumann boundary condition. Using the GDM framework enables to develop an analysis that…

Numerical Analysis · Mathematics 2018-10-09 Jerome Droniou , Neela Nataraj , Devika Shylaja

Optimization is at the heart of machine learning, statistics and many applied scientific disciplines. It also has a long history in physics, ranging from the minimal action principle to finding ground states of disordered systems such as…

Optimization and Control · Mathematics 2021-05-11 Guilherme França , Daniel P. Robinson , René Vidal

Advanced measurement techniques and high performance computing have made large data sets available for a wide range of turbulent flows that arise in engineering applications. Drawing on this abundance of data, dynamical models can be…

Fluid Dynamics · Physics 2020-05-06 Armin Zare , Tryphon T. Georgiou , Mihailo R. Jovanović

We consider in this work a system of two stochastic differential equations named the perturbed compositional gradient flow. By introducing a separation of fast and slow scales of the two equations, we show that the limit of the slow motion…

Probability · Mathematics 2018-07-26 Wenqing Hu , Chris Junchi Li

We consider a class of optimization problems on the space of probability measures motivated by the mean-field approach to studying neural networks. Such problems can be solved by constructing continuous-time gradient flows that converge to…

Optimization and Control · Mathematics 2026-02-18 Petra Lazić , Linshan Liu , Mateusz B. Majka

Gradient flow in the 2-Wasserstein space is widely used to optimize functionals over probability distributions and is typically implemented using an interacting particle system with $n$ particles. Analyzing these algorithms requires showing…

Machine Learning · Computer Science 2026-03-27 Chandan Tankala , Dheeraj M. Nagaraj , Anant Raj

For addressing optimisation tasks on finite dimensional quantum systems, we give a comprehensive account of the foundations of gradient flows on Riemannian manifolds including new developments: we extend former results from Lie groups such…

Quantum Physics · Physics 2010-12-07 T. Schulte-Herbrueggen , S. J. Glaser , G. Dirr , U. Helmke