English
Related papers

Related papers: The Barycenter Method for Direct Optimization: an …

200 papers

In this paper, we propose a proximal gradient method and an accelerated proximal gradient method for solving composite optimization problems, where the objective function is the sum of a smooth and a convex, possibly nonsmooth, function. We…

Optimization and Control · Mathematics 2025-07-22 Raghu Bollapragada , Shagun Gupta

A robust clustering method for probabilities in Wasserstein space is introduced. This new "trimmed $k$-barycenters" approach relies on recent results on barycenters in Wasserstein space that allow intensive computation, as required by…

Methodology · Statistics 2019-02-06 E. del Barrio , J. A. Cuesta-Albertos , C. Matrán , A. Mayo-Íscar

The graduated optimization approach, also known as the continuation method, is a popular heuristic to solving non-convex problems that has received renewed interest over the last decade. Despite its popularity, very little is known in terms…

Machine Learning · Computer Science 2015-07-28 Elad Hazan , Kfir Y. Levy , Shai Shalev-Shwartz

This paper presents and investigates an inexact proximal gradient method for solving composite convex optimization problems characterized by an objective function composed of a sum of a full-domain differentiable convex function and a…

Optimization and Control · Mathematics 2025-04-16 Yunier Bello-Cruz , Max L. N. Gonçalves , Jefferson G. Melo , Cassandra Mohr

In this study, we consider an optimization problem with uncertainty dependent on decision variables, which has recently attracted attention due to its importance in machine learning and pricing applications. In this problem, the gradient of…

Optimization and Control · Mathematics 2024-12-31 Yuya Hikima , Akiko Takeda

An efficient method for computing solutions to the Optimal Transportation (OT) problem with a wide class of cost functions is presented. The standard linear programming (LP) discretization of the continuous problem becomes intractible for…

Numerical Analysis · Mathematics 2015-09-15 Adam M. Oberman , Yuanlong Ruan

We present an optimal gradient method for smooth strongly convex optimization. The method is optimal in the sense that its worst-case bound on the distance to an optimal point exactly matches the lower bound on the oracle complexity for the…

Optimization and Control · Mathematics 2022-06-15 Adrien Taylor , Yoel Drori

Given a discrete probability measure supported on $N$ atoms and a set of $n$ real-valued functions, there exists a probability measure that is supported on a subset of $n+1$ of the original $N$ atoms and has the same mean when integrated…

Machine Learning · Computer Science 2020-11-30 Francesco Cosentino , Harald Oberhauser , Alessandro Abate

This article overviews how gradient flows, and discretizations thereof, are useful to design and analyze optimization and sampling algorithms. The interplay between optimization, sampling, and gradient flows is an active research area; our…

Computation · Statistics 2023-02-23 N. Garcia Trillos , B. Hosseini , D. Sanz-Alonso

A piecewise constant Mayer cost function is used to model optimal control problems in which the state space is partitioned into several regions, each having its own Mayer cost value. In such a context, the standard numerical methods used in…

Optimization and Control · Mathematics 2021-12-02 P. -Y. Bouchet , C. Audet , L. Bourdin

We study derivative-free methods for policy optimization over the class of linear policies. We focus on characterizing the convergence rate of these methods when applied to linear-quadratic systems, and study various settings of driving…

Machine Learning · Computer Science 2020-05-19 Dhruv Malik , Ashwin Pananjady , Kush Bhatia , Koulik Khamaru , Peter L. Bartlett , Martin J. Wainwright

This paper studies the benefits of pressure-robust discretizations in the scope of optimal control of incompressible flows. Gradient forces that may appear in the data can have a negative impact on the accuracy of state and control and can…

Optimization and Control · Mathematics 2022-03-07 Christian Merdon , Winnifried Wollner

We develop a class of barycenter problems based on mean field control problems in three dimensions with associated reactive-diffusion systems of unnormalized multi-species densities. This problem is the generalization of the Wasserstein…

Optimization and Control · Mathematics 2024-04-03 Arjun Vijaywargiya , Guosheng Fu , Stanley Osher , Wuchen Li

In this paper we consider bound-constrained mixed-integer optimization problems where the objective function is differentiable w.r.t.\ the continuous variables for every configuration of the integer variables. We mainly suggest to exploit…

Optimization and Control · Mathematics 2026-01-19 Matteo Lapucci , Giampaolo Liuzzi , Stefano Lucidi , Pierluigi Mansueto

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. Bayesian optimization is a popular iterative method where a Gaussian process posterior of the underlying function is sequentially…

Computation · Statistics 2022-08-18 Oskar Gustafsson , Mattias Villani , Pär Stockhammar

Inverse problems are ubiquitous because they formalize the integration of data with mathematical models. In many scientific applications the forward model is expensive to evaluate, and adjoint computations are difficult to employ; in this…

Dynamical Systems · Mathematics 2021-11-05 G. A. Pavliotis , A. M. Stuart , U. Vaes

In this paper, we analyze several methods for approximating gradients of noisy functions using only function values. These methods include finite differences, linear interpolation, Gaussian smoothing and smoothing on a sphere. The methods…

Optimization and Control · Mathematics 2021-03-29 Albert S. Berahas , Liyuan Cao , Krzysztof Choromanski , Katya Scheinberg

There are many approaches for training decision trees. This work introduces a novel gradient-based method for constructing decision trees that optimize arbitrary differentiable loss functions, overcoming the limitations of heuristic…

Machine Learning · Computer Science 2025-03-25 Andrei V. Konstantinov , Lev V. Utkin

We present a multilevel stochastic gradient descent method for the optimal control of systems governed by partial differential equations under uncertain input data. The gradient descent method used to find the optimal control leverages a…

Optimization and Control · Mathematics 2025-06-04 Niklas Baumgarten , David Schneiderhan

The Wasserstein barycenter extends the Euclidean mean to the space of probability measures by minimizing the weighted sum of squared 2-Wasserstein distances. We develop a free-support algorithm for computing Wasserstein barycenters that…

Machine Learning · Statistics 2025-09-17 Kisung You