English
Related papers

Related papers: Adjacency Criterion For Gradient Flow With Multipl…

200 papers

Stochastic gradient descent (SGD) has been studied extensively over the past decades due to its simplicity and broad applicability in machine learning. In this work, we analyze the local behavior of gradient descent and stochastic gradient…

Optimization and Control · Mathematics 2026-05-15 Sebastian Kassing , Thomas Kruse

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

We study the two-player communication problem of determining whether two vertices $x, y$ are nearby in a graph $G$, with the goal of determining the graph structures that allow the problem to be solved with a constant-cost randomized…

Data Structures and Algorithms · Computer Science 2023-12-18 Louis Esperet , Nathaniel Harms , Andrey Kupavskii

We study a new two-time-scale stochastic gradient method for solving optimization problems, where the gradients are computed with the aid of an auxiliary variable under samples generated by time-varying MDPs controlled by the underlying…

Optimization and Control · Mathematics 2024-08-27 Sihan Zeng , Thinh T. Doan , Justin Romberg

We consider stochastic approximations which arise from such applications as data communications and image processing. We demonstrate why constraints are needed in a stochastic approximation and how a constrained approximation can be…

Numerical Analysis · Mathematics 2015-09-01 Hong Jiang , Gang Huang , Paul Wilford , Liangkai Yu

We consider the (sub-Riemannian type) control problem of finding a path going from an initial point $x$ to a target point $y$, by only moving in certain admissible directions. We assume that the corresponding vector fields satisfy the…

Optimization and Control · Mathematics 2025-12-16 Paul Gassiat , Florin Suciu

Four classic criteria used to the classification of complex flows are discussed here. These criteria are useful to identify regions of the flow related to shear, elongation or rigid-body motion. These usual criteria, namely $Q$, $\Delta$,…

Monin-Obukhov similarity theory (MOST) is used in virtually every Earth System Model (ESM) to parameterize the near-surface turbulent exchanges, however there is high uncertainty in the literature about the appropriate parameterizations to…

Atmospheric and Oceanic Physics · Physics 2023-10-12 Samuele Mosso , Marc Calaf , Ivana Stiperski

We develop the theory of linear evolution equations associated with the adjacency matrix of a graph, focusing in particular on infinite graphs of two kinds: uniformly locally finite graphs as well as locally finite line graphs. We discuss…

Dynamical Systems · Mathematics 2018-07-26 Delio Mugnolo

For addressing optimisation tasks on finite dimensional quantum systems, we give a comprehensive account of the foundations of gradient flows on Riemannian manifolds including new developments: we extend former results from Lie groups such…

Quantum Physics · Physics 2010-12-07 T. Schulte-Herbrueggen , S. J. Glaser , G. Dirr , U. Helmke

Assuming a-priori a smooth generating vector field, we introduce a generally covariant measure of the flow geometry called the referential gradient of the flow. The main result is the explicit relation between the referential gradient and…

Mathematical Physics · Physics 2014-11-21 J. K. Edmondson

Employing a recently proposed separability criterion we develop analytical lower bounds for the concurrence and for the entanglement of formation of bipartite quantum systems. The separability criterion is based on a nondecomposable…

Quantum Physics · Physics 2007-05-23 Heinz-Peter Breuer

The method of characteristics is a classical method for gaining understanding in the solution of a partial differential equation. It has recently been applied to the adjoint equations of the 2D Euler equations and the first goal of this…

Fluid Dynamics · Physics 2023-05-08 Kevin Ancourt , Jacques Peter , Olivier Atinault

Fitting a function by using linear combinations of a large number $N$ of `simple' components is one of the most fruitful ideas in statistical learning. This idea lies at the core of a variety of methods, from two-layer neural networks to…

Statistics Theory · Mathematics 2019-08-20 Adel Javanmard , Marco Mondelli , Andrea Montanari

The equations of motion describing buoyant fluids are often simplified using a set of approximations proposed by J. Boussinesq one century ago. To resume, they consist in assuming constant fluid properties, incompressibility and…

Classical Physics · Physics 2007-10-19 Philippe-Emmanuel P. -E. Roche

For Markov processes with absorption, we provide general criteria ensuring the existence and the exponential non-uniform convergence in total variation norm to a quasi-stationary distribution. We also characterize a subset of its domain of…

Probability · Mathematics 2022-10-24 Nicolas Champagnat , Denis Villemonais

A dynamical system is defined in terms of the gradient of a payoff function. Dynamical variables are of two types, ascent and descent. The ascent variables move in the direction of the gradient, while the descent variables move in the…

Optimization and Control · Mathematics 2019-03-07 H. Sebastian Seung

The present article is dedicated to proving convergence of the stochastic gradient method in case of random shape optimization problems. To that end, we consider Bernoulli's exterior free boundary problem with a random interior boundary. We…

Optimization and Control · Mathematics 2024-08-12 Marc Dambrine , Caroline Geiersbach , Helmut Harbrecht

Flow matching has emerged as a powerful framework for generative modeling through continuous normalizing flows. We investigate a potential topological constraint: when the prior distribution and target distribution have mismatched topology…

Machine Learning · Computer Science 2025-12-16 Congzhou M Sha

A simple model to handle the flow of people in emergency evacuation situations is considered: at every point x, the velocity U(x) that individuals at x would like to realize is given. Yet, the incompressibility constraint prevents this…

Analysis of PDEs · Mathematics 2010-02-04 Bertrand Maury , Aude Roudneff-Chupin , Filippo Santambrogio