English
Related papers

Related papers: A Splitting Augmented Lagrangian Method for Low Mu…

200 papers

This paper proposes a novel approach to solving nonlinear programming problems using a sharp augmented Lagrangian method with a smoothing technique. Traditional sharp augmented Lagrangian methods are known for their effectiveness but are…

Optimization and Control · Mathematics 2024-10-07 José Luis Romero , Damián Fernandez , Germán Ariel Torres

In this paper, we present a stochastic augmented Lagrangian approach on (possibly infinite-dimensional) Riemannian manifolds to solve stochastic optimization problems with a finite number of deterministic constraints.We investigate the…

Optimization and Control · Mathematics 2025-04-01 Caroline Geiersbach , Tim Suchan , Kathrin Welker

Tensor completion can estimate missing values of a high-order data from its partially observed entries. Recent works show that low rank tensor ring approximation is one of the most powerful tools to solve tensor completion problem. However,…

Numerical Analysis · Mathematics 2021-01-03 Abdul Ahad , Zhen Long , Ce Zhu , Yipeng Liu

Lagrangian relaxation is a versatile mathematical technique employed to relax constraints in an optimization problem, enabling the generation of dual bounds to prove the optimality of feasible solutions and the design of efficient…

Artificial Intelligence · Computer Science 2023-12-25 Augustin Parjadis , Quentin Cappart , Bistra Dilkina , Aaron Ferber , Louis-Martin Rousseau

We report a computational study of cutting plane algorithms for multi-stage stochastic mixed-integer programming models with the following cuts: (i) Benders', (ii) Integer L-shaped, and (iii) Lagrangian cuts. We first show that Integer…

Optimization and Control · Mathematics 2024-05-07 Akul Bansal , Simge Küçükyavuz

We study the computational complexity certification of inexact gradient augmented Lagrangian methods for solving convex optimization problems with complicated constraints. We solve the augmented Lagrangian dual problem that arises from the…

Optimization and Control · Mathematics 2013-02-19 Valentin Nedelcu , Ion Necoara , Quoc Tran Dinh

In this paper, we propose a Robbins-Monro augmented Lagrangian method (RMALM) to solve a class of constrained stochastic convex optimization, which can be regarded as a hybrid of the Robbins-Monro type stochastic approximation method and…

Optimization and Control · Mathematics 2022-09-02 Rui Wang , Chao Ding

This paper proposes a novel approach to tensor completion, which recovers missing entries of data represented by tensors. The approach is based on the tensor train (TT) rank, which is able to capture hidden information from tensors thanks…

Numerical Analysis · Computer Science 2017-04-26 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

Multilinear systems play an important role in scientific calculations of practical problems. In this paper, we consider a tensor splitting method with a relaxed Anderson acceleration for solving multilinear systems. The new method preserves…

Numerical Analysis · Mathematics 2024-10-18 Dongdong Liu Ting Hua nd Xifu Liu

We investigate new methods for generating Lagrangian cuts to solve two-stage stochastic integer programs. Lagrangian cuts can be added to a Benders reformulation, and are derived from solving single scenario integer programming subproblems…

Optimization and Control · Mathematics 2022-04-07 Rui Chen , James Luedtke

This paper studies a class of double-loop (inner-outer) algorithms for convex composite optimization. For unconstrained problems, we develop a restarted accelerated composite gradient method that attains the optimal first-order complexity…

Optimization and Control · Mathematics 2026-02-23 Matthew X. Burns , Jiaming Liang

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

This work studies the Tensor Robust Principal Component Analysis (TRPCA) problem, which aims to exactly recover the low-rank and sparse components from their sum. Our model is motivated by the recently proposed linear transforms based…

Machine Learning · Computer Science 2019-07-22 Canyi Lu , Pan Zhou

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex…

Machine Learning · Statistics 2015-03-10 Yuning Yang , Siamak Mehrkanoon , Johan A. K. Suykens

The augmented Lagrangian method (ALM) is classic for canonical convex programming problems with linear constraints, and it finds many applications in various scientific computing areas. A major advantage of the ALM is that the step for…

Optimization and Control · Mathematics 2022-12-02 Bingsheng He , Feng Ma , Shengjie Xu , Xiaoming Yuan

In this work, we focus on separable convex optimization problems with box constraints and a set of triangular linear constraints. The solution is given in closed-form as a function of some Lagrange multipliers that can be computed through…

Information Theory · Computer Science 2015-06-22 Antonio A. D'Amico , Luca Sanguinetti , Daniel P. Palomar

With the advancement of the data acquisition techniques, multi-view learning has become a hot topic. Some multi-view learning methods assume that the multi-view data is complete, which means that all instances are present, but this too…

Machine Learning · Computer Science 2022-08-09 Heng Zhang , Xiaohong Chen

Low-rank tensors appear to be prosperous in many applications. However, the sets of bounded-rank tensors are non-smooth and non-convex algebraic varieties, rendering the low-rank optimization problems to be challenging. To this end, we…

Optimization and Control · Mathematics 2024-11-22 Bin Gao , Renfeng Peng , Ya-xiang Yuan

The surge of activity in the resolution of fine scale features in the field of earth sciences over the past decade necessitates the development of robust yet simple algorithms that can tackle the various drawbacks of in silico models…

Numerical Analysis · Mathematics 2021-07-27 Saumik Dana