English
Related papers

Related papers: Penalty Alternating Direction Methods for Mixed-In…

200 papers

In recent years, numerous vision and learning tasks have been (re)formulated as nonconvex and nonsmooth programmings(NNPs). Although some algorithms have been proposed for particular problems, designing fast and flexible optimization…

Computer Vision and Pattern Recognition · Computer Science 2017-07-03 Yiyang Wang , Risheng Liu , Xiaoliang Song , Zhixun Su

This paper addresses the challenging issue of symmetry in mixed-integer convex optimization problems, which frequently arise in real-world applications such as the unit commitment problem. Although variable aggregation techniques have been…

Optimization and Control · Mathematics 2026-02-05 Junhao Wu , Shaoze Li , Cheng Lu , Zhibin Deng , Shu-Cherng Fang

In this paper, we consider nonsmooth composite optimization over compact embedded submanifolds defined by nonlinear equality constraints. We propose a feasibility-safeguarded inexact proximal linearized method (FSIPL), which allows…

Optimization and Control · Mathematics 2026-05-26 Xiyua Xie , Qia Li

This paper proposes a novel numerical method for solving the problem of decision making under cumulative prospect theory (CPT), where the goal is to maximize utility subject to practical constraints, assuming only finite realizations of the…

Optimization and Control · Mathematics 2024-04-29 Xiangyu Cui , Rujun Jiang , Yun Shi , Rufeng Xiao , Yifan Yan

In this paper, we consider a stochastic Model Predictive Control able to account for effects of additive stochastic disturbance with unbounded support, and requiring no restrictive assumption on either independence nor Gaussianity. We…

Systems and Control · Electrical Eng. & Systems 2020-03-17 Martina Mammarella , Teodoro Alamo , Sergio Lucia , Fabrizio Dabbene

Equilibrium equations in the form of complementarity conditions often appear as constraints in optimization problems. Problems of this type are commonly referred to as mathematical programs with complementarity constraints (MPCCs). A…

Optimization and Control · Mathematics 2025-10-20 Sven Leyffer

In high-dimensional model selection problems, penalized simple least-square approaches have been extensively used. This paper addresses the question of both robustness and efficiency of penalized model selection methods, and proposes a…

Methodology · Statistics 2011-07-06 Jelena Bradic , Jianqing Fan , Weiwei Wang

The primal-dual active set method is observed to be the limit of a sequence of penalty formulations. Using this perspective, we propose a penalty method that adaptively becomes the active set method as the residual of the iterate decreases.…

Optimization and Control · Mathematics 2022-01-10 Wietse M. Boon , Jan M. Nordbotten

Recently, semidefinite programming performance estimation has been employed as a strong tool for the worst-case performance analysis of first order methods. In this paper, we derive new non-ergodic convergence rates for the alternating…

Optimization and Control · Mathematics 2023-05-25 Moslem Zamani , Hadi Abbaszadehpeivasti , Etienne de Klerk

We design sparse and block sparse feedback gains that minimize the variance amplification (i.e., the $H_2$ norm) of distributed systems. Our approach consists of two steps. First, we identify sparsity patterns of feedback gains by…

Optimization and Control · Mathematics 2013-12-30 Fu Lin , Makan Fardad , Mihailo R. Jovanović

The alternating direction method of multipliers (ADMM) is a powerful splitting algorithm for linearly constrained convex optimization problems. In view of its popularity and applicability, a growing attention is drawn towards the ADMM in…

Optimization and Control · Mathematics 2022-08-19 Sedi Bartz , Rubén Campoy , Hung M. Phan

A new approach to linear programming duality is proposed which relies on quadratic penalization, so that the relation between solutions to the penalized primal and dual problems becomes affine. This yields a new proof of Levin's duality…

Optimization and Control · Mathematics 2013-09-13 Jonathan Korman , Robert J. McCann , Christian Seis

In this paper we propose an iterative method using alternating direction method of multipliers (ADMM) strategy to solve linear inverse problems in Hilbert spaces with general convex penalty term. When the data is given exactly, we give a…

Numerical Analysis · Mathematics 2016-01-13 Yuling Jiao , Qinian Jin , Xiliang Lu , Weijie Wang

This paper provides a theoretical and numerical investigation of a penalty decomposition scheme for the solution of optimization problems with geometric constraints. In particular, we consider some situations where parts of the constraints…

Optimization and Control · Mathematics 2023-03-23 Matteo Lapucci , Christian Kanzow

In fluid-structure interaction problems, some people use a penalty method for positioning the structure inside the fluid. This is usually performed by considering that the fluid is very stiff or/and very heavy at the place occupied by the…

Numerical Analysis · Mathematics 2020-11-19 Philippe Destuynder , Erwan Liberge

This work proposes a novel adaptive linearized alternating direction multiplier method (LADMM) to convex optimization, which improves the convergence rate of the LADMM-based algorithm by adjusting step-size iteratively.The innovation of…

Optimization and Control · Mathematics 2024-07-04 Boran Wang

In this paper, we propose an inertial alternating direction method of multipliers for solving a class of non-convex multi-block optimization problems with \emph{nonlinear coupling constraints}. Distinctive features of our proposed method,…

Optimization and Control · Mathematics 2024-02-22 Le Thi Khanh Hien , Dimitri Papadimitriou

In many learning tasks, certain requirements on the processing of individual data samples should arguably be formalized as strict constraints in the underlying optimization problem, rather than by means of arbitrary penalties. We show that,…

Machine Learning · Computer Science 2026-01-26 Francesca Lanzillotta , Chiara Albisani , Davide Pucci , Daniele Baracchi , Alessandro Piva , Matteo Lapucci

Alternating direction multiplication is a powerful technique for solving convex optimisation problems. When challenging subproblems are encountered in the real world, it is useful to solve them by introducing neighbourhood terms. When the…

Optimization and Control · Mathematics 2024-04-29 Boran Wang

We consider minimization problems with structured objective function and smooth constraints, and present a flexible framework that combines the beneficial regularization effects of (exact) penalty and interior-point methods. In the fully…

Optimization and Control · Mathematics 2025-08-27 Alberto De Marchi , Andreas Themelis