English
Related papers

Related papers: A Sequential Homotopy Method for Mathematical Prog…

200 papers

First-order stochastic methods for solving large-scale non-convex optimization problems are widely used in many big-data applications, e.g. training deep neural networks as well as other complex and potentially non-convex machine learning…

Machine Learning · Computer Science 2020-11-23 Matilde Gargiani , Andrea Zanelli , Quoc Tran-Dinh , Moritz Diehl , Frank Hutter

In this paper we apply an augmented Lagrange method to a class of semilinear elliptic optimal control problems with pointwise state constraints. We show strong convergence of subsequences of the primal variables to a local solution of the…

Optimization and Control · Mathematics 2018-10-25 Veronika Karl , Ira Neitzel , Daniel Wachsmuth

We present an extension to high-order of a first-order Lagrange-projection like method for the approximation of the Euler equations introduced in Coquel {\it et al.} (Math. Comput., 79 (2010), pp.~1493--1533). The method is based on a…

Numerical Analysis · Mathematics 2016-02-05 Florent Renac

Many large-scale and distributed optimization problems can be brought into a composite form in which the objective function is given by the sum of a smooth term and a nonsmooth regularizer. Such problems can be solved via a proximal…

Optimization and Control · Mathematics 2020-06-26 Sepideh Hassan-Moghaddam , Mihailo R. Jovanović

We solve large-scale mixed-integer linear programs (MILPs) via distributed asynchronous saddle point computation. This is motivated by the MILPs being able to model problems in multi-agent autonomy, e.g., task assignment problems and…

Optimization and Control · Mathematics 2022-11-23 Luke Fina , Matthew Hale

We consider a general linear parabolic problem with extended time boundary conditions (including initial value problems and periodic ones), and approximate it by the implicit Euler scheme in time and the Gradient Discretisation method in…

Numerical Analysis · Mathematics 2023-08-22 J Droniou , R Eymard , T Gallouët , C Guichard , R Herbin

This work introduces a sequential convex programming framework for non-linear, finite-dimensional stochastic optimal control, where uncertainties are modeled by a multidimensional Wiener process. We prove that any accumulation point of the…

Optimization and Control · Mathematics 2022-09-27 Riccardo Bonalli , Thomas Lew , Marco Pavone

The nonlinear optimization problem with linear constraints has many applications in engineering fields such as the visual-inertial navigation and localization of an unmanned aerial vehicle maintaining the horizontal flight. In order to…

Numerical Analysis · Mathematics 2020-11-03 Xin-long Luo , Jia-hui Lv , Geng Sun

In this work, we present an efficient gradient projection method for solving a class of stochastic optimal control problem with expected integral state constraint. The first order optimality condition system consisting of forward-backward…

Optimization and Control · Mathematics 2024-12-24 Qiming Wang , Wenbin Liu

This paper proposes novel gradient-flow schemes that yield convergence to the optimal point of a convex optimization problem within a \textit{fixed} time from any given initial condition for unconstrained optimization, constrained…

Optimization and Control · Mathematics 2022-04-27 Kunal Garg , Dimitra Panagou

This work focuses on numerical solutions of optimal control problems. A time discretization error representation is derived for the approximation of the associated value function. It concerns Symplectic Euler solutions of the Hamiltonian…

Optimization and Control · Mathematics 2016-02-23 Jesper Karlsson , Stig Larsson , Mattias Sandberg , Anders Szepessy , Raùl Tempone

We present a new feasible proximal gradient method for constrained optimization where both the objective and constraint functions are given by the summation of a smooth, possibly nonconvex function and a convex simple function. The…

Optimization and Control · Mathematics 2024-02-01 Digvijay Boob , Qi Deng , Guanghui Lan

Dual first-order methods are powerful techniques for large-scale convex optimization. Although an extensive research effort has been devoted to studying their convergence properties, explicit convergence rates for the primal iterates have…

Optimization and Control · Mathematics 2015-02-24 Jie Lu , Mikael Johansson

This paper studies the distributed optimization problem when the objective functions might be nondifferentiable and subject to heterogeneous set constraints. Unlike existing subgradient methods, we focus on the case when the exact…

Optimization and Control · Mathematics 2021-11-23 Kui Zhu , Yutao Tang

We propose a globally-accelerated, first-order method for the optimization of smooth and (strongly or not) geodesically-convex functions in a wide class of Hadamard manifolds. We achieve the same convergence rates as Nesterov's accelerated…

Optimization and Control · Mathematics 2023-01-18 David Martínez-Rubio , Sebastian Pokutta

Many inverse problems and signal processing problems involve low-rank regularizers based on the nuclear norm. Commonly, proximal gradient methods (PGM) are adopted to solve this type of non-smooth problems as they can offer fast and…

Signal Processing · Electrical Eng. & Systems 2025-11-25 Rodrigo A. Lobos , Javier Salazar Cavazos , Raj Rao Nadakuditi , Jeffrey A. Fessler

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

This paper considers the distributed smooth optimization problem in which the objective is to minimize a global cost function formed by a sum of local smooth cost functions, by using local information exchange. The standard assumption for…

Optimization and Control · Mathematics 2019-09-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Karl H. Johansson , Tianyou Chai

We introduce a novel approach addressing global analysis of a difficult class of nonconvex-nonsmooth optimization problems within the important framework of Lagrangian-based methods. This genuine nonlinear class captures many problems in…

Optimization and Control · Mathematics 2018-01-10 Jérôme Bolte , Shoham Sabach , Marc Teboulle

This work presents an algorithmic scheme for solving the infinite-time constrained linear quadratic regulation problem. We employ an accelerated version of a popular proximal gradient scheme, commonly known as the Forward-Backward Splitting…

Optimization and Control · Mathematics 2015-01-20 Giorgos Stathopoulos , Milan Korda , Colin N. Jones