English
Related papers

Related papers: A preconditioned second-order convex splitting alg…

200 papers

In this paper we present a variant of the proximal forward-backward splitting iteration for solving nonsmooth optimization problems in Hilbert spaces, when the objective function is the sum of two nondifferentiable convex functions. The…

Optimization and Control · Mathematics 2016-01-13 Jose Yunier Bello Cruz

Optimization of DR-submodular functions has experienced a notable surge in significance in recent times, marking a pivotal development within the domain of non-convex optimization. Motivated by real-world scenarios, some recent works have…

Machine Learning · Computer Science 2024-01-18 Loay Mualem , Murad Tukan , Moran Fledman

We design and analyze a novel accelerated gradient-based algorithm for a class of bilevel optimization problems. These problems have various applications arising from machine learning and image processing, where optimal solutions of the two…

Optimization and Control · Mathematics 2023-11-20 Sepideh Samadi , Daniel Burbano , Farzad Yousefian

We consider the convex bilevel optimization problem, also known as simple bilevel programming. There are two challenges in solving convex bilevel optimization problems. Firstly, strong duality is not guaranteed due to the lack of Slater…

Optimization and Control · Mathematics 2025-09-29 Khanh-Hung Giang-Tran , Nam Ho-Nguyen , Fatma Kılınç-Karzan , Lingqing Shen

We develop block structure adapted primal-dual algorithms for non-convex non-smooth optimisation problems whose objectives can be written as compositions $G(x)+F(K(x))$ of non-smooth block-separable convex functions $G$ and $F$ with a…

Optimization and Control · Mathematics 2020-09-25 Stanislav Mazurenko , Jyrki Jauhiainen , Tuomo Valkonen

We study the convergence properties of the 'greedy' Frank-Wolfe algorithm with a unit step size, for a convex maximization problem over a compact set. We assume the function satisfies smoothness and strong convexity. These assumptions…

Optimization and Control · Mathematics 2025-05-02 Fatih Selim Aktas , Christian Kroer

In this paper, we study a class of nonconvex and nonsmooth structured difference-of-convex (DC) programs, which contain in the convex part the sum of a nonsmooth linearly composed convex function and a differentiable function, and in the…

Optimization and Control · Mathematics 2025-05-06 Radu Ioan Bot , Rossen Nenov , Min Tao

Proximal operators with affine constraints arise in numerous models in nonconvex projection, composite optimization, and structured regularization. However, their efficient computation remains challenging due to the simultaneous presence of…

Optimization and Control · Mathematics 2026-03-02 Di Hou , Tianyun Tang , Kim-Chuan Toh , Shiwei Wang

Optimal power flow (OPF) is an important problem for power generation and it is in general non-convex. With the employment of renewable energy, it will be desirable if OPF can be solved very efficiently so its solution can be used in real…

Optimization and Control · Mathematics 2011-09-27 Albert Y. S. Lam , Baosen Zhang , David Tse

In this paper, we propose a trigonometric-interpolation approach for solutions of second order nonlinear ODEs with mixed boundary conditions. The method interpolates secondary derivative $y''$ of a target solution $y$ by a trigonometric…

Numerical Analysis · Mathematics 2025-04-29 Xiaorong Zou

Motivated by the emergence of federated learning (FL), we design and analyze federated methods for addressing: (i) Nondifferentiable nonconvex optimization; (ii) Bilevel optimization; (iii) Minimax problems; and (iv) Two-stage stochastic…

Optimization and Control · Mathematics 2025-07-04 Yuyang Qiu , Uday V. Shanbhag , Farzad Yousefian

Inverse problem or parameter estimation of ordinary differential equations (ODEs), the iterative process of minimizing the mismatch between model-predicted and experimental states by tuning the parameter values within an optimization…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Siddharth Prabhu , Srinivas Rangarajan , Mayuresh Kothare

We introduce a first order method for solving very large convex cone programs. The method uses an operator splitting method, the alternating directions method of multipliers, to solve the homogeneous self-dual embedding, an equivalent…

Optimization and Control · Mathematics 2016-07-27 Brendan O'Donoghue , Eric Chu , Neal Parikh , Stephen Boyd

Difference of Convex (DC) optimization problems have objective functions that are differences between two convex functions. Representative ways of solving these problems are the proximal DC algorithms, which require that the convex part of…

Optimization and Control · Mathematics 2022-09-27 Shota Takahashi , Mituhiro Fukuda , Mirai Tanaka

Distributed optimization, where the computations are performed in a localized and coordinated manner using multiple agents, is a promising approach for solving large-scale optimization problems, e.g., those arising in model predictive…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Wentao Tang , Prodromos Daoutidis

The first part of this work established the foundations of a radial duality between nonnegative optimization problems, inspired by the work of (Renegar, 2016). Here we utilize our radial duality theory to design and analyze projection-free…

Optimization and Control · Mathematics 2022-11-15 Benjamin Grimmer

Based on a preconditioned version of the randomized block-coordinate forward-backward algorithm recently proposed in [Combettes,Pesquet,2014], several variants of block-coordinate primal-dual algorithms are designed in order to solve a wide…

Optimization and Control · Mathematics 2014-10-28 Jean-Christophe Pesquet , Audrey Repetti

Bilevel optimization (BLO) problem, where two optimization problems (referred to as upper- and lower-level problems) are coupled hierarchically, has wide applications in areas such as machine learning and operations research. Recently, many…

Optimization and Control · Mathematics 2025-05-19 Xiaotian Jiang , Ioannis Tsaknakis , Prashant Khanduri , Mingyi Hong

We propose a novel methodology for solving a two-stage adjustable robust convex optimisation problem with a general (proximable) convex objective function and constraints defined by sum-of-squares (SOS) convex polynomials. These problems…

Optimization and Control · Mathematics 2026-02-17 Neil D. Dizon , Bethany I. Caldwell , Vaithilingam Jeyakumar , Guoyin Li

In this paper, we consider a class of structured nonsmooth fractional minimization, where the first part of the objective is the ratio of a nonnegative nonsmooth nonconvex function to a nonnegative nonsmooth convex function, while the…

Optimization and Control · Mathematics 2025-12-25 Junpeng Zhou , Na Zhang , Qia Li