English
Related papers

Related papers: Penalty Dual Decomposition Method For Nonsmooth No…

200 papers

We consider a two-stage stochastic optimization problem, in which a long-term optimization variable is coupled with a set of short-term optimization variables in both objective and constraint functions. Despite that two-stage stochastic…

Optimization and Control · Mathematics 2021-07-07 An Liu , Rui Yang , Tony Q. S. Quek , Min-Jian Zhao

In this paper we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints, are locally smooth. For solving this problem, we propose a…

Optimization and Control · Mathematics 2024-12-02 Lahcen El Bourkhissi , Ion Necoara

A class of exact penalty-type local search methods for optimal control problems with nonsmooth cost functional, nonsmooth (but continuous) dynamics, and nonsmooth state and control constraints is presented, in which the the penalty…

Optimization and Control · Mathematics 2023-02-21 M. V. Dolgopolik

This paper addresses the problem of nonconvex nonsmooth decentralised optimisation in multi-agent networks with undirected connected communication graphs. Our contribution lies in introducing an algorithmic framework designed for the…

Optimization and Control · Mathematics 2023-12-08 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

Motivated by variational models in continuum mechanics, we introduce a novel algorithm to perform nonsmooth and nonconvex minimizations with linear constraints in Euclidean spaces. We show how this algorithm is actually a natural…

Analysis of PDEs · Mathematics 2015-03-20 Marco Artina , Massimo Fornasier , Francesco Solombrino

The distributed nonconvex optimization problem of minimizing a global cost function formed by a sum of $n$ local cost functions by using local information exchange is considered. This problem is an important component of many machine…

Optimization and Control · Mathematics 2022-01-11 Xinlei Yi , Shengjun Zhang , Tao Yang , Tianyou Chai , Karl H. Johansson

We consider a non-convex constrained Lagrangian formulation of a fundamental bi-criteria optimization problem for variable selection in statistical learning; the two criteria are a smooth (possibly) nonconvex loss function, measuring the…

Optimization and Control · Mathematics 2016-11-22 Ying Sun , Gesualdo Scutari

This paper presents a twice continuously differentiable penalty function for nonlinear semidefinite programming problems. In some optimization methods, such as penalty methods and augmented Lagrangian methods, their convergence property can…

Optimization and Control · Mathematics 2025-09-25 Yuya Yamakawa

This paper proposes an improved quasi-Newton penalty decomposition algorithm for the minimization of continuously differentiable functions, possibly nonconvex, over sparse symmetric sets. The method solves a sequence of penalty subproblems…

Optimization and Control · Mathematics 2026-01-21 Ahmad Mousavi , Morteza Kimiaei , Saman Babaie-Kafaki , Vyacheslav Kungurtsev

This paper extends the SQP-approach of the well-known bundle-Newton method for nonsmooth unconstrained minimization to the nonlinearly constrained case. Instead of using a penalty function or a filter or an improvement function to deal with…

Optimization and Control · Mathematics 2015-06-29 Hannes Fendl , Hermann Schichl

We contribute improvements to a Lagrangian dual solution approach applied to large-scale optimization problems whose objective functions are convex, continuously differentiable and possibly nonlinear, while the non-relaxed constraint set is…

Optimization and Control · Mathematics 2019-08-09 Brian Dandurand , Natashia Boland , Jeffrey Christiansen , Andrew Eberhard , Fabricio Oliveira

This paper proposes and analyzes a dampened proximal alternating direction method of multipliers (DP.ADMM) for solving linearly-constrained nonconvex optimization problems where the smooth part of the objective function is nonseparable.…

Optimization and Control · Mathematics 2023-01-05 Weiwei Kong , Renato D. C. Monteiro

Consider the problem of minimizing the sum of a smooth (possibly non-convex) and a convex (possibly nonsmooth) function involving a large number of variables. A popular approach to solve this problem is the block coordinate descent (BCD)…

Optimization and Control · Mathematics 2014-11-03 Meisam Razaviyayn , Mingyi Hong , Zhi-Quan Luo , Jong-Shi Pang

In this paper, we propose an inexact perturbed path-following algorithm in the framework of Lagrangian dual decomposition for solving large-scale structured convex optimization problems. Unlike the exact versions considered in literature,…

Optimization and Control · Mathematics 2011-09-16 Quoc Tran Dinh , Ion Necoara , Carlo Savorgnan , Moritz Diehl

This paper introduces a novel approach to solving multi-block nonconvex composite optimization problems through a proximal linearized Alternating Direction Method of Multipliers (ADMM). This method incorporates an Increasing Penalization…

Optimization and Control · Mathematics 2025-04-01 Ganzhao Yuan

An optimization algorithm for a group of nonsmooth nonconvex problems inspired by two-stage stochastic programming problems is proposed. The main challenges for these problems include (1) the problems lack the popular lower-type properties…

Optimization and Control · Mathematics 2022-04-01 Jingyi Wang , Cosmin G. Petra

This dissertation explores block decomposable methods for large-scale optimization problems. It focuses on alternating direction method of multipliers (ADMM) schemes and block coordinate descent (BCD) methods. Specifically, it introduces a…

Optimization and Control · Mathematics 2026-01-15 Leandro Farias Maia

The Hadamard decomposition is a powerful technique for data analysis and matrix compression, which decomposes a given matrix into the element-wise product of two or more low-rank matrices. In this paper, we develop an efficient algorithm to…

Machine Learning · Computer Science 2025-04-23 Samuel Wertz , Arnaud Vandaele , Nicolas Gillis

Linear Programming (LP) is an important decoding technique for binary linear codes. However, the advantages of LP decoding, such as low error floor and strong theoretical guarantee, etc., come at the cost of high computational complexity…

Signal Processing · Electrical Eng. & Systems 2020-06-16 Yi Wei , Ming-Min Zhao , Min-Jian Zhao , Ming Lei

We investigate the distributed multi-agent sharing optimization problem in a directed graph, with a composite objective function consisting of a smooth function plus a convex (possibly non-smooth) function shared by all agents. While…

Optimization and Control · Mathematics 2024-06-21 Sajad Zandi , Mehdi Korki