English
Related papers

Related papers: An Optimization Framework with Flexible Inexact In…

200 papers

Adaptive algorithms like AdaGrad and AMSGrad are successful in nonconvex optimization owing to their parameter-agnostic ability -- requiring no a priori knowledge about problem-specific parameters nor tuning of learning rates. However, when…

Optimization and Control · Mathematics 2022-10-17 Junchi Yang , Xiang Li , Niao He

This paper is devoted to first-order algorithms for smooth convex optimization with inexact gradients. Unlike the majority of the literature on this topic, we consider the setting of relative rather than absolute inexactness. More…

Optimization and Control · Mathematics 2023-10-03 Nikita Kornilov , Eduard Gorbunov , Mohammad Alkousa , Fedor Stonyakin , Pavel Dvurechensky , Alexander Gasnikov

As dynamical systems equipped with neural network controllers (neural feedback systems) become increasingly prevalent, it is critical to develop methods to ensure their safe operation. Verifying safety requires extending control theoretic…

Systems and Control · Electrical Eng. & Systems 2026-04-15 I. Samuel Akinwande , Chelsea Sidrane , Mykel J. Kochenderfer , Clark Barrett

This paper aims to study a majorized alternating direction method of multipliers with indefinite proximal terms (iPADMM) for convex composite optimization problems. We show that the majorized iPADMM for 2-block convex optimization problems…

Optimization and Control · Mathematics 2018-02-08 Ning Zhang , Jia Wu , Liwei Zhang

Solving parabolic optimal control problems can be inherently challenging in the field of science and engineering, especially with constraints on the nonsmooth distributed control. Motivated by the extensive applicability of the alternating…

Optimization and Control · Mathematics 2026-03-03 Haiming Song , Jinda Yang , Yuran Yang , Jianhua Yuan

An algorithm framework is proposed for minimizing nonsmooth functions. The framework is variable-metric in that, in each iteration, a step is computed using a symmetric positive definite matrix whose value is updated as in a quasi-Newton…

Optimization and Control · Mathematics 2019-02-05 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

This manuscript develops a new framework to analyze and design iterative optimization algorithms built on the notion of Integral Quadratic Constraints (IQC) from robust control theory. IQCs provide sufficient conditions for the stability of…

Optimization and Control · Mathematics 2021-05-27 Laurent Lessard , Benjamin Recht , Andrew Packard

We propose a general formulation of nonconvex and nonsmooth sparse optimization problems with convex set constraint, which can take into account most existing types of nonconvex sparsity-inducing terms, bringing strong applicability to a…

Information Theory · Computer Science 2021-08-23 Hao Wang , Fan Zhang , Yuanming Shi , Yaohua Hu

We propose a new proximal, path-following framework for a class of constrained convex problems. We consider settings where the nonlinear---and possibly non-smooth---objective part is endowed with a proximity operator, and the constraint set…

Optimization and Control · Mathematics 2016-12-28 Quoc Tran-Dinh , Anastasios Kyrillidis , Volkan Cevher

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

We propose a novel exact algorithm for the transportation problem, one of the paradigmatic network optimization problems. The algorithm, denoted Iterated Inside Out, requires in input a basic feasible solution and is composed by two main…

Optimization and Control · Mathematics 2023-03-30 Roberto Bargetto , Federico Della Croce , Rosario Scatamacchia

This paper focuses on the design of sequential quadratic optimization (commonly known as SQP) methods for solving large-scale nonlinear optimization problems. The most computationally demanding aspect of such an approach is the computation…

Optimization and Control · Mathematics 2020-02-27 James V. Burke , Frank E. Curtis , Hao Wang , Jiashan Wang

We present an algorithm for minimizing the sum of a strongly convex time-varying function with a time-invariant, convex, and nonsmooth function. The proposed algorithm employs the prediction-correction scheme alongside the forward-backward…

Optimization and Control · Mathematics 2024-05-07 Nicola Bastianello , Andrea Simonetto , Ruggero Carli

In this paper we generalize the Interior Point-Proximal Method of Multipliers (IP-PMM) presented in [An Interior Point-Proximal Method of Multipliers for Convex Quadratic Programming, Computational Optimization and Applications, 78,…

Optimization and Control · Mathematics 2021-09-09 Spyridon Pougkakiotis , Jacek Gondzio

Large-scale nonsmooth optimization problems arise in many real-world applications, but obtaining exact function and subgradient values for these problems may be computationally expensive or even infeasible. In many practical settings, only…

Optimization and Control · Mathematics 2026-04-10 Jenni Lampainen , Kaisa Joki , Napsu Karmitsa , Marko M. Mäkelä

We consider an inertial primal-dual fixed point algorithm (IPDFP) to compute the minimizations of the following Problem (1.1). This is a full splitting approach, in the sense that the nonsmooth functions are processed individually via their…

Optimization and Control · Mathematics 2016-04-20 Meng Wen , Yu-Chao Tang , Jigen Peng

While globally optimal solutions to many convex programs can be computed efficiently in polynomial time, this is, in general, not possible for nonconvex optimization problems. Therefore, locally optimal approaches or other efficient…

Information Theory · Computer Science 2020-07-03 Bho Matthiesen , Christoph Hellings , Eduard A. Jorswieck , Wolfgang Utschick

The proximal gradient algorithm has been popularly used for convex optimization. Recently, it has also been extended for nonconvex problems, and the current state-of-the-art is the nonmonotone accelerated proximal gradient algorithm.…

Optimization and Control · Mathematics 2017-05-24 Quanming Yao , James T. Kwok , Fei Gao , Wei Chen , Tie-Yan Liu

Model predictive control problems for constrained hybrid systems are usually cast as mixed-integer optimization problems (MIP). However, commercial MIP solvers are designed to run on desktop computing platforms and are not suited for…

Optimization and Control · Mathematics 2020-02-05 Damian Frick , Angelos Georghiou , Juan L. Jerez , Alexander Domahidi , Manfred Morari

Alternating structure-adapted proximal (ASAP) gradient algorithm (M. Nikolova and P. Tan, SIAM J Optim, 29:2053-2078, 2019) has drawn much attention due to its efficiency in solving nonconvex nonsmooth optimization problems. However, the…

Optimization and Control · Mathematics 2024-06-26 Ying Gao , Chunfeng Cui , Wenxing Zhang , Deren Han