English
Related papers

Related papers: Variable Projected Augmented Lagrangian Methods fo…

200 papers

In this paper, we consider the minimization of a nonsmooth nonconvex objective function $f(x)$ over a closed convex subset $\mathcal{X}$ of $\mathbb{R}^n$, with additional nonsmooth nonconvex constraints $c(x) = 0$. We develop a unified…

Optimization and Control · Mathematics 2024-04-16 Nachuan Xiao , Kuangyu Ding , Xiaoyin Hu , Kim-Chuan Toh

State-of-the-art techniques for simultaneous localization and mapping (SLAM) employ iterative nonlinear optimization methods to compute an estimate for robot poses. While these techniques often work well in practice, they do not provide…

Robotics · Computer Science 2015-07-21 Luca Carlone , David Rosen , Giuseppe Calafiore , John Leonard , Frank Dellaert

In this paper, we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems, and variational inequalities. This framework allows obtaining many…

In this paper we propose a proximal algorithm for minimizing an objective function of two block variables consisting of three terms: 1) a smooth function, 2) a nonsmooth function which is a composition between a strictly increasing,…

Optimization and Control · Mathematics 2022-09-15 Maryam Yashtini

We propose a variant of the classical augmented Lagrangian method for constrained optimization problems in Banach spaces. Our theoretical framework does not require any convexity or second-order assumptions and allows the treatment of…

Optimization and Control · Mathematics 2018-07-13 Christian Kanzow , Daniel Steck , Daniel Wachsmuth

We propose a semi-proximal augmented Lagrangian based decomposition method for convex composite quadratic conic programming problems with primal block angular structures. Using our algorithmic framework, we are able to naturally derive…

Optimization and Control · Mathematics 2018-12-13 Xin-Yee Lam , Defeng Sun , Kim-Chuan Toh

In this work, we propose a preconditioned augmented Lagrangian method (ALM) for solving semidefinite programming (SDP) problems. The preconditioner is implemented via a weighted penalty function in the ALM subproblem, with the weight matrix…

Optimization and Control · Mathematics 2026-05-19 Tianyun Tang , Kim-Chuan Toh

Contrastive decoding strategies are widely used to mitigate object hallucinations in multimodal large language models (MLLMs). By reducing over-reliance on language priors, these strategies ensure that generated content remains closely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Hao Yin , Guangzong Si , Zilei Wang

The Augmented Lagrangian Method (ALM) is an iterative method for the solution of equality-constrained non-linear programming problems. In contrast to the quadratic penalty method, the ALM can satisfy equality constraints in an exact way.…

Numerical Analysis · Mathematics 2018-04-24 Martin Neuenhofen

In this paper, we consider augmented Lagrangian (AL) algorithms for solving large-scale nonlinear optimization problems that execute adaptive strategies for updating the penalty parameter. Our work is motivated by the recently proposed…

Optimization and Control · Mathematics 2017-01-02 Frank E. Curtis , Nicholas I. M. Gould , Hao Jiang , Daniel P. Robinson

We compare alternative computing strategies for solving the constrained lasso problem. As its name suggests, the constrained lasso extends the widely-used lasso to handle linear constraints, which allow the user to incorporate prior…

Machine Learning · Statistics 2016-11-08 Brian R. Gaines , Hua Zhou

Unsupervised visual anomaly detection from multi-view images presents a significant challenge: distinguishing genuine defects from benign appearance variations caused by viewpoint changes. Existing methods, often designed for single-view…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Xintao Chen , Xiaohao Xu , Bozhong Zheng , Yun Liu , Yingna Wu

Large Vision-Language Models (LVLMs) have advanced rapidly by aligning visual patches with the text embedding space, but a fixed visual-token budget forces images to be resized to a uniform pretraining resolution, often erasing fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Zipeng Zhu , Zhanghao Hu , Qinglin Zhu , Yuxi Hong , Yijun Liu , Jingyong Su , Yulan He , Lin Gui

A reciprocal LASSO (rLASSO) regularization employs a decreasing penalty function as opposed to conventional penalization approaches that use increasing penalties on the coefficients, leading to stronger parsimony and superior model…

Methodology · Statistics 2021-09-17 Himel Mallick , Rahim Alhamzawi , Erina Paul , Vladimir Svetnik

The Lasso is a prominent algorithm for variable selection. However, its instability in the presence of correlated variables in the high-dimensional setting is well-documented. Although previous research has attempted to address this issue…

Methodology · Statistics 2025-05-28 Mahdi Nouraie , Connor Smith , Samuel Muller

The advent of parameter-efficient fine-tuning methods has significantly reduced the computational burden of adapting large-scale pretrained models to diverse downstream tasks. However, existing approaches often struggle to achieve robust…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Haotian Zhang , Liu Liu , Baosheng Yu , Jiayan Qiu , Yanwei Ren , Xianglong Liu

Magnetic Resonance Imaging (MRI) is one of the fields that the compressed sensing theory is well utilized to reduce the scan time significantly leading to faster imaging or higher resolution images. It has been shown that a small fraction…

Information Theory · Computer Science 2014-06-03 Cagdas Bilen , Yao Wang , Ivan Selesnick

Super-resolution is an important but difficult problem in image/video processing. If a video sequence or some training set other than the given low-resolution image is available, this kind of extra information can greatly aid in the…

Computer Vision and Pattern Recognition · Computer Science 2007-09-13 Heng Lian

In this paper, we present a stochastic augmented Lagrangian approach on (possibly infinite-dimensional) Riemannian manifolds to solve stochastic optimization problems with a finite number of deterministic constraints.We investigate the…

Optimization and Control · Mathematics 2025-04-01 Caroline Geiersbach , Tim Suchan , Kathrin Welker

Although much research has been devoted to the problem of restoring Poissonian images, namely in the fields of medical and astronomical imaging, applying the state of the art regularizers (such as those based on wavelets or total variation)…

Optimization and Control · Mathematics 2009-05-01 Mario A. T. Figueiredo , Jose M. Bioucas-Dias