English
Related papers

Related papers: A stochastic Gauss-Newton algorithm for regularize…

200 papers

We give a new and constructive proof of the existence of global-in-time weak solutions of the 3-dimensional incompressible semi-geostrophic equations (SG) in geostrophic coordinates, for arbitrary initial measures with compact support. This…

Analysis of PDEs · Mathematics 2022-01-19 David P. Bourne , Charlie P. Egan , Beatrice Pelloni , Mark Wilkinson

We propose and analyze a stochastic Newton algorithm for homogeneous distributed stochastic convex optimization, where each machine can calculate stochastic gradients of the same population objective, as well as stochastic Hessian-vector…

Optimization and Control · Mathematics 2021-10-08 Brian Bullins , Kumar Kshitij Patel , Ohad Shamir , Nathan Srebro , Blake Woodworth

In this report, we study decentralized stochastic optimization to minimize a sum of smooth and strongly convex cost functions when the functions are distributed over a directed network of nodes. In contrast to the existing work, we use…

Machine Learning · Computer Science 2020-07-24 Muhammad I. Qureshi , Ran Xin , Soummya Kar , Usman A. Khan

This work focuses on developing and motivating a stochastic version of a wellknown inverse problem methodology. Specifically, we consider the iteratively regularized Gauss-Newton method, originally proposed by Bakushinskii for…

Numerical Analysis · Mathematics 2024-09-20 El Houcine Bergou , Neil K. Chada , Youssef Diouane

This chapter describes techniques for the numerical resolution of optimal transport problems. We will consider several discretizations of these problems, and we will put a strong focus on the mathematical analysis of the algorithms to solve…

Numerical Analysis · Mathematics 2020-03-03 Quentin Merigot , Boris Thibert

We study optimal transport between two high-dimensional distributions $\mu,\nu$ in $R^n$ from an algorithmic perspective: given $x \sim \mu$, find a close $y \sim \nu$ in $poly(n)$ time, where $n$ is the dimension of $x,y$. Thus, running…

Data Structures and Algorithms · Computer Science 2025-09-29 Salman Beigi , Omid Etesami , Mohammad Mahmoody , Amir Najafi

Optimal transport is the problem of designing a joint distribution for two random variables with fixed marginals. In virtually the entire literature on this topic, the objective is to minimize expected cost. This paper is the first to study…

Econometrics · Economics 2026-02-13 Yinchu Zhu , Ilya O. Ryzhov

We introduce deterministic perturbation schemes for the recently proposed random directions stochastic approximation (RDSA) [17], and propose new first-order and second-order algorithms. In the latter case, these are the first second-order…

Optimization and Control · Mathematics 2019-03-29 Prashanth L A , Shalabh Bhatnagar , Nirav Bhavsar , Michael Fu , Steven I. Marcus

Stochastic nonconvex optimization problems with nonlinear constraints have a broad range of applications in intelligent transportation, cyber-security, and smart grids. In this paper, first, we propose an inexact-proximal accelerated…

Optimization and Control · Mathematics 2021-07-08 Morteza Boroun , Afrooz Jalilzadeh

We propose and analyse a novel, fully discrete numerical algorithm for the approximation of the generalised Stokes system forced by transport noise -- a prototype model for non-Newtonian fluids including turbulence. Utilising the Gradient…

Numerical Analysis · Mathematics 2024-12-20 Jerome Droniou , Kim-Ngan Le , Jörn Wichmann

This work presents a novel version of recently developed Gauss-Newton method for solving systems of nonlinear equations, based on upper bound of solution residual and quadratic regularization ideas. We obtained for such method global…

Optimization and Control · Mathematics 2021-05-04 Nikita Yudin , Alexander Gasnikov

Motivated by applications in optimization and machine learning, we consider stochastic quasi-Newton (SQN) methods for solving stochastic optimization problems. In the literature, the convergence analysis of these algorithms relies on strong…

Optimization and Control · Mathematics 2016-03-16 Farzad Yousefian , Angelia Nedić , Uday V. Shanbha

We introduce a new non-linear optimal transport formulation for a pair of probability measures on $\mathbb{R}^d$ sharing a common barycentre, in which admissible transference plans satisfy two martingale-type constraints. This bi-martingale…

Probability · Mathematics 2025-11-03 Karol Bołbotowski

We consider an extension of the Monge-Kantorovitch optimal transportation problem. The mass is transported along a continuous semimartingale, and the cost of transportation depends on the drift and the diffusion coefficients of the…

Probability · Mathematics 2013-10-04 Xiaolu Tan , Nizar Touzi

We prove the Duality Theorems for the stochastic optimal transportation problems with a convex cost function without a regularity assumption that is often supposed in the proof of the lower semicontinuity of an action integral. In our new…

Probability · Mathematics 2021-01-18 Toshio Mikami

We propose a numerical method to find the optimal transport map between a measure supported on a lower-dimensional subset of R^d and a finitely supported measure. More precisely, the source measure is assumed to be supported on a simplex…

Computational Geometry · Computer Science 2017-07-06 Quentin Mérigot , Jocelyn Meyron , Boris Thibert

We establish numerical methods for solving the martingale optimal transport problem (MOT) - a version of the classical optimal transport with an additional martingale constraint on transport's dynamics. We prove that the MOT value can be…

Probability · Mathematics 2019-04-08 Gaoyue Guo , Jan Obloj

This paper proposes a stochastic variant of a classic algorithm---the cubic-regularized Newton method [Nesterov and Polyak 2006]. The proposed algorithm efficiently escapes saddle points and finds approximate local minima for general…

Machine Learning · Computer Science 2017-12-07 Nilesh Tripuraneni , Mitchell Stern , Chi Jin , Jeffrey Regier , Michael I. Jordan

We rephrase Monge's optimal transportation (OT) problem with quadratic cost--via a Monge-Amp\`ere equation--as an infinite-dimensional optimization problem, which is in fact a convex problem when the target is a log-concave measure with…

Numerical Analysis · Mathematics 2017-08-29 Michael Lindsey , Yanir A. Rubinstein

Classic optimal transport theory is formulated through minimizing the expected transport cost between two given distributions. We propose the framework of distorted optimal transport by minimizing a distorted expected cost, which is the…

Optimization and Control · Mathematics 2025-05-20 Haiyan Liu , Bin Wang , Ruodu Wang , Sheng Chao Zhuang