English
Related papers

Related papers: Ordinary differential equations for regularized va…

200 papers

Regularization robust preconditioners for PDE-constrained optimization problems have been successfully developed. These methods, however, typically assume that observation data is available throughout the entire domain of the state…

Optimization and Control · Mathematics 2015-06-23 Kent-André Mardal , Bjørn Fredrik Nielsen , Magne Nordaas

Regularized optimal transport (OT) is now increasingly used as a loss or as a matching layer in neural networks. Entropy-regularized OT can be computed using the Sinkhorn algorithm but it leads to fully-dense transportation plans, meaning…

Machine Learning · Statistics 2023-04-17 Tianlin Liu , Joan Puigcerver , Mathieu Blondel

Differential equations perturbed by multiplicative fractional Brownian motions are considered. Depending on the value of the Hurst parameter $H$, the resulting equation is pathwise viewed as an ODE, YDE, or RDE. In all three regimes we show…

Probability · Mathematics 2024-09-25 Konstantinos Dareiotis , Máté Gerencsér

Random ordinary differential equations (RODEs), i.e. ODEs with random parameters, are often used to model complex dynamics. Most existing methods to identify unknown governing RODEs from observed data often rely on strong prior knowledge.…

Numerical Analysis · Mathematics 2020-06-04 Junyu Liu , Zichao Long , Ranran Wang , Jie Sun , Bin Dong

Optimal transportation provides a means of lifting distances between points on a geometric domain to distances between signals over the domain, expressed as probability distributions. On a graph, transportation problems can be used to…

Optimization and Control · Mathematics 2018-03-26 Montacer Essid , Justin Solomon

In this work, the authors address the Optimal Transport (OT) problem on graphs using a proximal stabilized Interior Point Method (IPM). In particular, strongly leveraging on the induced primal-dual regularization, the authors propose to…

Optimization and Control · Mathematics 2023-07-12 Stefano Cipolla , Jacek Gondzio , Filippo Zanetti

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on…

Machine Learning · Computer Science 2020-03-19 Stefano Massaroli , Michael Poli , Michelangelo Bin , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

We analyze continuous optimal transport problems in the so-called Kantorovich form, where we seek a transport plan between two marginals that are probability measures on compact subsets of Euclidean space. We consider the case of…

Optimization and Control · Mathematics 2020-10-28 Christian Clason , Dirk A. Lorenz , Hinrich Mahler , Benedikt Wirth

In this paper, we study ordinary differential equations (ODE) coupled with solutions of a stochastic nonsmooth convex optimization problem (SNCOP). We use the regularization approach, the sample average approximation and the time-stepping…

Optimization and Control · Mathematics 2025-02-11 Jianfeng Luo , Xiaojun Chen

Following [21, 23], the present work investigates a new relative entropy-regularized algorithm for solving the optimal transport on a graph problem within the randomized shortest paths formalism. More precisely, a unit flow is injected into…

Machine Learning · Computer Science 2021-09-21 Sylvain Courtain , Guillaume Guex , Ilkka Kivimaki , Marco Saerens

We introduce a new second order stochastic algorithm to estimate the entropically regularized optimal transport cost between two probability measures. The source measure can be arbitrary chosen, either absolutely continuous or discrete,…

Statistics Theory · Mathematics 2022-03-03 Bernard Bercu , Jérémie Bigot , Sébastien Gadat , Emilia Siviero

Optimal transport problems pose many challenges when considering their numerical treatment. We investigate the solution of a PDE-constrained optimisation problem subject to a particular transport equation arising from the modelling of image…

Numerical Analysis · Mathematics 2018-01-15 Roland Herzog , John W. Pearson , Martin Stoll

In this paper, we introduce and develop the theory of semimartingale optimal transport in a path dependent setting. Instead of the classical constraints on marginal distributions, we consider a general framework of path dependent…

Probability · Mathematics 2020-09-15 Ivan Guo , Gregoire Loeper

Common computational problems, such as parameter estimation in dynamic models and PDE constrained optimization, require data fitting over a set of auxiliary parameters subject to physical constraints over an underlying state. Naive…

Optimization and Control · Mathematics 2017-09-19 Aleksandr Y. Aravkin , Dmitriy Drusvyatskiy , Tristan van Leeuwen

In this paper, we discuss optimality conditions for optimization problems involving random state constraints, which are modeled in probabilistic or almost sure form. While the latter can be understood as the limiting case of the former, the…

Optimization and Control · Mathematics 2024-01-17 Caroline Geiersbach , René Henrion

Training Neural Ordinary Differential Equations (ODEs) is often computationally expensive. Indeed, computing the forward pass of such models involves solving an ODE which can become arbitrarily complex during training. Recent works have…

Machine Learning · Computer Science 2020-11-03 Arnab Ghosh , Harkirat Singh Behl , Emilien Dupont , Philip H. S. Torr , Vinay Namboodiri

Regularising the primal formulation of optimal transport (OT) with a strictly convex term leads to enhanced numerical complexity and a denser transport plan. Many formulations impose a global constraint on the transport plan, for instance…

Machine Learning · Computer Science 2023-10-05 Hugues Van Assel , Titouan Vayer , Remi Flamary , Nicolas Courty

PDE-constrained optimal control problems require regularisation to ensure well-posedness, introducing small perturbations that make the solutions challenging to approximate accurately. We propose a finite element approach that couples both…

Numerical Analysis · Mathematics 2025-03-17 Jenny Power , Tristan Pryer

Optimal transport (OT) serves as a natural framework for comparing probability measures, with applications in statistics, machine learning, and applied mathematics. Alas, statistical estimation and exact computation of the OT distances…

Statistics Theory · Mathematics 2024-05-14 Tao Wang , Ziv Goldfeld

In this paper we investigate an adaptive discretization strategy for ill-posed linear prob- lems combined with a regularization from a class of semiiterative methods. We show that such a discretization approach in combination with a…

Numerical Analysis · Mathematics 2014-07-22 Wolfgang Erb , Evgeniya V. Semenova