English
Related papers

Related papers: A simple and efficient algorithm for fused lasso s…

200 papers

Zero-One Composite Optimization (0/1-COP) is a prototype of nonsmooth, nonconvex optimization problems and it has attracted much attention recently. The augmented Lagrangian Method (ALM) has stood out as a leading methodology for such…

Optimization and Control · Mathematics 2023-06-16 Penghe Zhang , Naihua Xiu , Hou-Duo Qi

We consider constructing a surface from a given set of point cloud data. We explore two fast algorithms to minimize the weighted minimum surface energy in [Zhao, Osher, Merriman and Kang, Comp.Vision and Image Under., 80(3):295-319, 2000].…

Numerical Analysis · Mathematics 2019-07-03 Yuchen He , Martin Huska , Sung Ha Kang , Hao Liu

The Lagrange multiplier method has proven highly effective for mitigating the ill-conditioning of full waveform inversion (FWI), enabling robust and computationally efficient algorithms that converge to accurate velocity models even from…

Geophysics · Physics 2025-10-01 Ali Gholami , Kamal Aghazade , Akshay Vishwakarma

Augmented Lagrangian (AL) methods are a well known class of algorithms for solving constrained optimization problems. They have been extended to the solution of saddle-point systems of linear equations. We study an AL (SPAL) algorithm for…

Numerical Analysis · Mathematics 2024-04-24 N. Huang , Y. -H. Dai , D. Orban , M. A. Saunders

Given a dissimilarity matrix, the metric nearness problem is to find the nearest matrix of distances that satisfy the triangle inequalities. This problem has wide applications, such as sensor networks, image processing, and so on. But it is…

Optimization and Control · Mathematics 2022-11-03 Peipei Tang , Bo Jiang , Chengjing Wang

In this paper, we consider the linear programming (LP) formulation for deep reinforcement learning. The number of the constraints depends on the size of state and action spaces, which makes the problem intractable in large or continuous…

Optimization and Control · Mathematics 2021-05-21 Yongfeng Li , Mingming Zhao , Weijie Chen , Zaiwen Wen

The Alternating Minimization Algorithm (AMA) has been proposed by Tseng to solve convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the latter is assumed to be…

Optimization and Control · Mathematics 2018-06-04 Sandy Bitterlich , Radu Ioan Bot , Ernö Robert Csetnek , Gert Wanka

This paper is concerned with a partially linear semiparametric regression model containing an unknown regression coefficient, an unknown nonparametric function, and an unobservable Gaussian distributed random error. We focus on the case of…

Methodology · Statistics 2026-01-06 Peili Li , Yunhai Xiao , Meixia Yang , Hanbing Zhu

rdering of regression or classification coefficients occurs in many real-world applications. Fused Lasso exploits this ordering by explicitly regularizing the differences between neighboring coefficients through an $\ell_1$ norm…

Computation · Statistics 2010-06-29 Gui-Bo Ye , Xiaohui Xie

A new algorithm for solving large-scale convex optimization problems with a separable objective function is proposed. The basic idea is to combine three techniques: Lagrangian dual decomposition, excessive gap and smoothing. The main…

Optimization and Control · Mathematics 2011-12-01 Tran Dinh Quoc , Carlo Savorgnan , Moritz Diehl

This paper presents a new linear hyperspectral unmixing method of the minimum volume class, termed \emph{simplex identification via split augmented Lagrangian} (SISAL). Following Craig's seminal ideas, hyperspectral linear unmixing amounts…

Optimization and Control · Mathematics 2016-11-17 Jose Bioucas-Dias

The augmented Lagrangiam method (ALM), widely used in quantum chemistry constrained optimization problems, is applied in the context of the nuclear Density Functional Theory (DFT) in the self-consistent constrained Skyrme…

Nuclear Theory · Physics 2014-11-21 A. Staszczak , M. Stoitsov , A. Baran , W. Nazarewicz

Physics and equality constrained artificial neural networks (PECANN) are grounded in methods of constrained optimization to properly constrain the solution of partial differential equations (PDEs) with their boundary and initial conditions…

Machine Learning · Computer Science 2023-07-18 Shamsulhaq Basir , Inanc Senocak

This paper provides a local convergence analysis of the proximal augmented Lagrangian method (PALM) applied to a class of non-convex conic programming problems. Previous convergence results for PALM typically imposed assumptions such as…

Optimization and Control · Mathematics 2025-09-16 Ning Zhang , Yi Zhang

In this paper, we propose a novel solution for non-convex problems of multiple variables, especially for those typically solved by an alternating minimization (AM) strategy that splits the original optimization problem into a set of…

Machine Learning · Computer Science 2022-06-28 Jingyuan Xia , Shengxi Li , Jun-Jie Huang , Imad Jaimoukha , Deniz Gunduz

Multi-task learning enhances model generalization by jointly learning from related tasks. This paper focuses on the $\ell_{1,\infty}$-norm constrained multi-task learning problem, which promotes a shared feature representation while…

Optimization and Control · Mathematics 2025-04-22 Lanyu Lin , Yong-Jin Liu , Bo Wang , Junfeng Yang

We investigate finite-dimensional constrained structured optimization problems, featuring composite objective functions and set-membership constraints. Offering an expressive yet simple language, this problem class provides a modeling…

Optimization and Control · Mathematics 2023-02-09 Alberto De Marchi , Xiaoxi Jia , Christian Kanzow , Patrick Mehlitz

In this paper, we introduce faster accelerated primal-dual algorithms for minimizing a convex function subject to strongly convex function constraints. Prior to our work, the best complexity bound was $\mathcal{O}(1/{\varepsilon})$,…

Optimization and Control · Mathematics 2024-11-28 Zhenwei Lin , Qi Deng

The Extreme Learning Machine (ELM) technique is a machine learning approach for constructing feed-forward neural networks with a single hidden layer and their models. The ELM model can be constructed while being trained by concurrently…

Optimization and Control · Mathematics 2024-01-30 Muideen Adegoke , Lateef O. Jolaoso , Mardiyyah Oduwole

The aim of this manuscript is to approach by means of first order differential equations/inclusions convex programming problems with two-block separable linear constraints and objectives, whereby (at least) one of the components of the…

Optimization and Control · Mathematics 2020-05-21 Sandy Bitterlich , Ernö Robert Csetnek , Gert Wanka