English
Related papers

Related papers: Penalty Alternating Direction Methods for Mixed-In…

200 papers

The chaotic nature of fluid flow and the uncertainties in initial conditions limit predictability. Small errors that occur in the initial condition can grow exponentially until they saturate at $\mathcal{O}$(1). Ensemble forecasting…

Numerical Analysis · Mathematics 2024-07-16 Rui Fang

This work describes PUSH, a primal heuristic combining Feasibility Pump and Shifting. The main idea is to replace the rounding phase of the Feasibility Pump with a suitable adaptation of the Shifting and other rounding heuristics. The…

Optimization and Control · Mathematics 2022-08-02 Giorgio Grani , Corrado Coppola , Valerio Agasucci

We propose an implicit iterative algorithm for an exact penalty method arising from inequality constrained optimization problems. A rapidly convergent fixed point method is developed for a regularized penalty functional. The applicability…

Optimization and Control · Mathematics 2012-10-05 Kazufumi Ito , Tomoya Takeuchi

Solving parabolic optimal control problems can be inherently challenging in the field of science and engineering, especially with constraints on the nonsmooth distributed control. Motivated by the extensive applicability of the alternating…

Optimization and Control · Mathematics 2026-03-03 Haiming Song , Jinda Yang , Yuran Yang , Jianhua Yuan

The alternating direction method of multipliers (ADMM) is a versatile tool for solving a wide range of constrained optimization problems, with differentiable or non-differentiable objective functions. Unfortunately, its performance is…

Machine Learning · Computer Science 2017-07-20 Zheng Xu , Mario A. T. Figueiredo , Tom Goldstein

Mean-variance portfolio optimization problems often involve separable nonconvex terms, including penalties on capital gains, integer share constraints, and minimum position and trade sizes. We propose a heuristic algorithm for such problems…

Optimization and Control · Mathematics 2022-07-04 Nicholas Moehle , Jack Gindi , Stephen Boyd , Mykel Kochenderfer

In equality-constrained optimization, a standard regularity assumption is often associated with feasible point methods, namely the gradients of constraints are linearly independent. In practice, the regularity assumption may be violated. To…

Neural and Evolutionary Computing · Computer Science 2020-03-10 Quan Quan , Kai-Yuan Cai

This paper combines two ingredients in order to get a rather surprising result on one of the most studied, elegant and powerful tools for solving convex feasibility problems, the method of alternating projections (MAP). Going back to names…

Optimization and Control · Mathematics 2021-11-11 Roger Behling , Yunier Bello-Cruz , Luiz-Rafael Santos

The alternating direction method of multipliers (ADMM) is a powerful algorithm for solving decentralized optimization problems including networked microgrid energy management (NetMEM). However, its performance is highly sensitive to the…

Systems and Control · Electrical Eng. & Systems 2025-11-13 Jesus Silva-Rodriguez , Xingpeng Li

This paper presents a twice continuously differentiable penalty function for nonlinear semidefinite programming problems. In some optimization methods, such as penalty methods and augmented Lagrangian methods, their convergence property can…

Optimization and Control · Mathematics 2025-09-25 Yuya Yamakawa

The penalization method is a popular technique to provide particle swarm optimizers with the ability to handle constraints. The downside is the need of penalization coefficients whose settings are problem-specific. While adaptive…

Neural and Evolutionary Computing · Computer Science 2021-01-28 Mauro S. Innocente , Johann Sienz

A new family of penalty functions, adaptive to likelihood, is introduced for model selection in general regression models. It arises naturally through assuming certain types of prior distribution on the regression parameters. To study…

Methodology · Statistics 2013-08-26 Yang Feng , Tengfei Li , Zhiliang Ying

In this paper, we propose a penalty dual-primal augmented lagrangian method for solving convex minimization problems under linear equality or inequality constraints. The proposed method combines a novel penalty technique with updates the…

Optimization and Control · Mathematics 2023-05-09 Jie Liu , Xiaoqing Ou , Jiawei Chen

We study tracking control for nonlinear systems with known relative degree and stable internal dynamics by the recently introduced technique of Funnel MPC. The objective is to achieve the evolution of the tracking error within a prescribed…

Optimization and Control · Mathematics 2022-05-26 Thomas Berger , Dario Dennstädt

This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functionals with block…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Luke Lozenski , Michael T. McCann , Brendt Wohlberg

Variable selection is fundamental to high-dimensional statistical modeling. Many variable selection techniques may be implemented by maximum penalized likelihood using various penalty functions. Optimizing the penalized likelihood function…

Statistics Theory · Mathematics 2007-06-13 David R. Hunter , Runze Li

The alternating direction method of multipliers (ADMM) is a flexible method to solve a large class of convex minimization problems. Particular features are its unconditional convergence with respect to the involved step size and its direct…

Numerical Analysis · Mathematics 2017-04-21 Sören Bartels , Marijo Milicevic

Mixed-integer optimization problems arise in a wide range of control applications. Benders decomposition is a widely used algorithm for solving such problems by decomposing them into a mixed-integer master problem and a continuous…

Optimization and Control · Mathematics 2026-04-07 Bernard T. Agyeman , Zhe Li , Ilias Mitrai , Prodromos Daoutidis

The alternating direction method of multipliers (ADMM) is a common optimization tool for solving constrained and non-differentiable problems. We provide an empirical study of the practical performance of ADMM on several nonconvex…

Optimization and Control · Mathematics 2016-12-13 Zheng Xu , Soham De , Mario Figueiredo , Christoph Studer , Tom Goldstein

We develop two new proximal alternating penalty algorithms to solve a wide range class of constrained convex optimization problems. Our approach mainly relies on a novel combination of the classical quadratic penalty, alternating…

Optimization and Control · Mathematics 2018-09-20 Quoc Tran-Dinh