English
Related papers

Related papers: Complexity certifications of first order inexact L…

200 papers

Convex quadratic programming (QP) is an essential class of optimization problems with broad applications across various fields. Traditional QP solvers, typically based on simplex or barrier methods, face significant scalability challenges.…

Optimization and Control · Mathematics 2024-10-08 Yicheng Huang , Wanyu Zhang , Hongpei Li , Dongdong Ge , Huikang Liu , Yinyu Ye

This work aims to minimize a continuously differentiable convex function with Lipschitz continuous gradient under linear equality constraints. The proposed inertial algorithm results from the discretization of the second-order primal-dual…

Optimization and Control · Mathematics 2022-08-03 Radu Ioan Bot , Ernö Robert Csetnek , Dang-Khoa Nguyen

Recently there has been an increasing interest in primal-dual methods for model predictive control (MPC), which require minimizing the (augmented) Lagrangian at each iteration. We propose a novel first order primal-dual method, termed…

Optimization and Control · Mathematics 2020-12-21 Yue Yu , Purnanand Elango , Behçet Açikmeşe

Quasi-convex optimization acts a pivotal part in many fields including economics and finance; the subgradient method is an effective iterative algorithm for solving large-scale quasi-convex optimization problems. In this paper, we…

Optimization and Control · Mathematics 2019-10-25 Yaohua Hu , Jiawen Li , Carisa Kwok Wai Yu

This paper describes a method for solving smooth nonconvex minimization problems subject to bound constraints with good worst-case complexity guarantees and practical performance. The method contains elements of two existing methods: the…

Optimization and Control · Mathematics 2023-06-08 Yue Xie , Stephen J. Wright

We design inexact proximal augmented Lagrangian based decomposition methods for convex composite programming problems with dual block-angular structures. Our methods are particularly well suited for convex quadratic programming problems…

Optimization and Control · Mathematics 2023-03-14 Kuang-Yu Ding , Xin-Yee Lam , Kim-Chuan Toh

We discuss non-Euclidean deterministic and stochastic algorithms for optimization problems with strongly and uniformly convex objectives. We provide accuracy bounds for the performance of these algorithms and design methods which are…

Optimization and Control · Mathematics 2014-01-09 Anatoli Iouditski , Yuri Nesterov

By introducing a quadratic perturbation to the canonical dual of the maxcut problem, we transform the integer programming problem into a concave maximization problem over a convex positive domain under some circumstances, which can be…

Optimization and Control · Mathematics 2012-10-16 Xiaojun Zhou

We suggest simple implementable modifications of conditional gradient and gradient projection methods for smooth convex optimization problems in Hilbert spaces. Usually, the custom methods attain only weak convergence. We prove strong…

Optimization and Control · Mathematics 2017-05-04 Igor Konnov

This paper considers a general class of iterative optimization algorithms, referred to as linear-optimization-based convex programming (LCP) methods, for solving large-scale convex programming (CP) problems. The LCP methods, covering the…

Optimization and Control · Mathematics 2014-06-30 Guanghui Lan

We develop an inexact primal-dual first-order smoothing framework to solve a class of non-bilinear saddle point problems with primal strong convexity. Compared with existing methods, our framework yields a significant improvement over the…

Optimization and Control · Mathematics 2023-07-25 Le Thi Khanh Hien , Renbo Zhao , William B. Haskell

The Knapsack Problem is a classic problem in combinatorial optimisation. Solving these problems may be computationally expensive. Recent years have seen a growing interest in the use of deep learning methods to approximate the solutions to…

Machine Learning · Computer Science 2023-12-07 Mitchell Keegan , Mahdi Abolghasemi

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

In this paper we study the worst-case complexity of an inexact Augmented Lagrangian method for nonconvex constrained problems. Assuming that the penalty parameters are bounded, we prove a complexity bound of $\mathcal{O}(|\log(\epsilon)|)$…

Optimization and Control · Mathematics 2021-05-25 Geovani N. Grapiglia , Ya-xiang Yuan

We study a class of optimization problems in which the objective function is given by the sum of a differentiable but possibly nonconvex component and a nondifferentiable convex regularization term. We introduce an auxiliary variable to…

Optimization and Control · Mathematics 2019-08-27 Neil K. Dhingra , Sei Zhen Khong , Mihailo R. Jovanović

We are interested in solving convex optimization problems with large numbers of constraints. Randomized algorithms, such as random constraint sampling, have been very successful in giving nearly optimal solutions to such problems. In this…

Optimization and Control · Mathematics 2016-11-29 William B. Haskell , Yu Pengqian

The linear primal-dual hybrid gradient (PDHG) method is a first-order method that splits convex optimization problems with saddle-point structure into smaller subproblems. Unlike those obtained in most splitting methods, these subproblems…

Optimization and Control · Mathematics 2022-04-05 Jérôme Darbon , Gabriel P. Langlois

The continuous nonlinear resource allocation problem (CONRAP) has broad applications in economics, engineering, production and inventory management, and often serves as a subproblem in complex programming. Without relying on monotonicity…

Optimization and Control · Mathematics 2025-01-10 Kaixiang Hu , Caixia Kou , Jianhua Yuan

In safety-critical applications, reinforcement learning (RL) needs to consider safety constraints. However, theoretical understandings of constrained RL for continuous control are largely absent. As a case study, this paper presents a…

Optimization and Control · Mathematics 2024-06-07 Feiran Zhao , Keyou You

In this paper, we provide the universal first-order methods of Composite Optimization with new complexity analysis. It delivers some universal convergence guarantees, which are not linked directly to any parametric problem class. However,…

Optimization and Control · Mathematics 2025-09-26 Yurii Nesterov