中文
相关论文

相关论文: Complexity and performance of an Augmented Lagrang…

200 篇论文

The Augmented Lagrangian Method as an approach for regularizing inverse problems received much attention recently, e.g. under the name Bregman iteration in imaging. This work shows convergence (rates) for this method when Morozov's…

数值分析 · 数学 2012-04-19 Klaus Frick , Dirk A. Lorenz , Elena Resmerita

In this work we reformulate the method presented in App. Opt. 53:2297 (2014) as a constrained minimization problem using the augmented Lagrangian method. First we introduce the new method and then describe the numerical solution, which…

数值分析 · 数学 2020-08-21 Ricardo Legarda-Saenz , Carlos Brito-Loeza

Lagrangian methods are widely used algorithms for constrained optimization problems, but their learning dynamics exhibit oscillations and overshoot which, when applied to safe reinforcement learning, leads to constraint-violating behavior…

最优化与控制 · 数学 2020-07-09 Adam Stooke , Joshua Achiam , Pieter Abbeel

In this paper, we establish for the first time the oracle complexity of a Riemannian inexact augmented Lagrangian (RiAL) method with the classical dual update for solving a class of Riemannian nonsmooth composite problems. By using the…

最优化与控制 · 数学 2024-10-03 Meng Xu , Bo Jiang , Ya-Feng Liu , Anthony Man-Cho So

The augmented Lagrangian method (ALM) has gained tremendous popularity for its elegant theory and impressive numerical performance since it was proposed by Hestenes and Powell in 1969. It has been widely used in numerous efficient solvers…

最优化与控制 · 数学 2022-08-09 Shiwei Wang , Chao Ding

First-order methods have been studied for nonlinear constrained optimization within the framework of the augmented Lagrangian method (ALM) or penalty method. We propose an improved inexact ALM (iALM) and conduct a unified analysis for…

最优化与控制 · 数学 2021-03-25 Zichong Li , Pin-Yu Chen , Sijia Liu , Songtao Lu , Yangyang Xu

Euler's elastica model has been extensively studied and applied to image processing tasks. However, due to the high nonlinearity and nonconvexity of the involved curvature term, conventional algorithms suffer from slow convergence and high…

图像与视频处理 · 电气工程与系统科学 2019-08-06 Yinghui Zhang , Xiaojuan Deng , Jun Zhang , Hongwei Li

We introduce a novel approach addressing global analysis of a difficult class of nonconvex-nonsmooth optimization problems within the important framework of Lagrangian-based methods. This genuine nonlinear class captures many problems in…

最优化与控制 · 数学 2018-01-10 Jérôme Bolte , Shoham Sabach , Marc Teboulle

We provide a correction to the sufficient conditions under which closed-form expressions for the optimal Lagrange multiplier are provided in arXiv:2112.13138 [math.OC]. We first present a simple counterexample where the original conditions…

最优化与控制 · 数学 2025-03-13 Henri Lefebvre , Anirudh Subramanyam

We present a numerical method for the minimization of constrained optimization problems where the objective is augmented with large quadratic penalties of inconsistent equality constraints. Such objectives arise from quadratic integral…

最优化与控制 · 数学 2021-08-16 Martin Neuenhofen , Eric Kerrigan

This paper proposes a new algorithm that solves non-convex optimal control problems with a theoretical guarantee for global convergence to a feasible local solution of the original problem. The proposed algorithm extends the recently…

最优化与控制 · 数学 2024-10-15 Kenshiro Oguri

Offline reinforcement learning (RL), which refers to decision-making from a previously-collected dataset of interactions, has received significant attention over the past years. Much effort has focused on improving offline RL practicality…

机器学习 · 计算机科学 2022-11-03 Paria Rashidinejad , Hanlin Zhu , Kunhe Yang , Stuart Russell , Jiantao Jiao

In this paper we study a nonconvex-strongly-concave constrained minimax problem. Specifically, we propose a first-order augmented Lagrangian method for solving it, whose subproblems are nonconvex-strongly-concave unconstrained minimax…

最优化与控制 · 数学 2026-01-06 Zhaosong Lu , Sanyou Mei

This paper proposes and analyzes a proximal augmented Lagrangian (NL-IAPIAL) method for solving smooth nonconvex composite optimization problems with nonlinear $\cal K$-convex constraints, i.e., the constraints are convex with respect to…

最优化与控制 · 数学 2022-07-06 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

We analyze the convergence behaviour of a recently proposed algorithm for regularized estimation called Dual Augmented Lagrangian (DAL). Our analysis is based on a new interpretation of DAL as a proximal minimization algorithm. We…

机器学习 · 统计学 2011-06-07 Ryota Tomioka , Taiji Suzuki , Masashi Sugiyama

In this paper we consider a class of convex conic programming. In particular, we first propose an inexact augmented Lagrangian (I-AL) method that resembles the classical I-AL method for solving this problem, in which the augmented…

最优化与控制 · 数学 2022-11-22 Zhaosong Lu , Zirui Zhou

In this paper, we present a stochastic augmented Lagrangian approach on (possibly infinite-dimensional) Riemannian manifolds to solve stochastic optimization problems with a finite number of deterministic constraints.We investigate the…

最优化与控制 · 数学 2025-04-01 Caroline Geiersbach , Tim Suchan , Kathrin Welker

We propose an inexact proximal augmented Lagrangian method (P-ALM) for nonconvex structured optimization problems. The proposed method features an easily implementable rule not only for updating the penalty parameters, but also for…

最优化与控制 · 数学 2025-09-04 Adeyemi D. Adeoye , Puya Latafat , Alberto Bemporad

The auxiliary problem principle of augmented Lagrangian (APP-AL), proposed by Cohen and Zhu (1984), aims to find the solution of a constrained optimization problem through a sequence of auxiliary problems involving augmented Lagrangian. The…

最优化与控制 · 数学 2017-01-17 Lei Zhao , Daoli Zhu , Bo Jiang

First-order methods have been popularly used for solving large-scale problems. However, many existing works only consider unconstrained problems or those with simple constraint. In this paper, we develop two first-order methods for…

最优化与控制 · 数学 2017-11-23 Yangyang Xu