English
Related papers

Related papers: Lasry-Lions Envelopes and Nonconvex Optimization: …

200 papers

We consider nonconvex optimization problem over simplex, and more generally, a product of simplices. We provide an algorithm, Langevin Multiplicative Weights Update (LMWU) for solving global optimization problems by adding a noise scaling…

Optimization and Control · Mathematics 2025-03-04 Yi Feng , Xiao Wang , Tian Xie

This work investigates the convergence behavior of augmented Lagrangian methods (ALMs) when applied to convex optimization problems that may be infeasible. ALMs are a popular class of algorithms for solving constrained optimization…

Optimization and Control · Mathematics 2026-03-17 Roland Andrews , Justin Carpentier , Adrien Taylor

Composite minimization involves a collection of smooth functions which are aggregated in a nonsmooth manner. In the convex setting, we design an algorithm by linearizing each smooth component in accordance with its main curvature. The…

Optimization and Control · Mathematics 2019-03-26 Jérôme Bolte , Zheng Chen , Edouard Pauwels

We associate with each convex optimization problem posed on some locally convex space with an infinite index set T, and a given non-empty family H formed by finite subsets of T, a suitable Lagrangian-Haar dual problem. We provide reverse…

Optimization and Control · Mathematics 2021-06-18 Nguyen Dinh , Miguel A. Goberna , Marco A. Lopez , Michel Volle

Near isometric orthogonal embeddings to lower dimensions are a fundamental tool in data science and machine learning. In this paper, we present the construction of such embeddings that minimizes the maximum distortion for a given set of…

Machine Learning · Statistics 2017-12-15 Kshiteej Sheth , Dinesh Garg , Anirban Dasgupta

In this paper we develop proximal methods for statistical learning. Proximal point algorithms are useful in statistics and machine learning for obtaining optimization solutions for composite functions. Our approach exploits closed-form…

Machine Learning · Statistics 2015-06-02 Nicholas G. Polson , James G. Scott , Brandon T. Willard

This work studies a class of non-smooth decentralized multi-agent optimization problems where the agents aim at minimizing a sum of local strongly-convex smooth components plus a common non-smooth term. We propose a general primal-dual…

Optimization and Control · Mathematics 2020-07-13 Sulaiman A. Alghunaim , Ernest K. Ryu , Kun Yuan , Ali H. Sayed

This paper proposes a proximal variant of the alternating direction method of multipliers (ADMM) for distributed optimization. Although the current versions of ADMM algorithm provide promising numerical results in producing solutions that…

Optimization and Control · Mathematics 2023-09-01 Reza Mirzaeifard , Naveen K. D. Venkategowda , Alexander Jung , Stefan Werner

Non-convex optimization problems have multiple local optimal solutions. Non-convex optimization problems are commonly found in numerous applications. One of the methods recently proposed to efficiently explore multiple local optimal…

Optimization and Control · Mathematics 2022-01-31 Mohamed Tarek , Yijiang Huang

We present an accelerated relax-and-round algorithm for concave coverage problems, which generalize the classic maximum coverage problem. Building on the relax-and-round framework of Barman et al. [STACS 2021], we propose two significant…

Data Structures and Algorithms · Computer Science 2026-05-11 Matthew Fahrbach , Mehraneh Liaee , Morteza Zadimoghaddam

We consider minimizing the sum of three convex functions, where the first one F is smooth, the second one is nonsmooth and proximable and the third one is the composition of a nonsmooth proximable function with a linear operator L. This…

Optimization and Control · Mathematics 2022-07-27 Adil Salim , Laurent Condat , Konstantin Mishchenko , Peter Richtárik

This paper proposes and analyzes a proximal augmented Lagrangian (NL-IAPIAL) method for solving smooth nonconvex composite optimization problems with nonlinear $\cal K$-convex constraints, i.e., the constraints are convex with respect to…

Optimization and Control · Mathematics 2022-07-06 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

This paper proposes and justifies two globally convergent Newton-type methods to solve unconstrained and constrained problems of nonsmooth optimization by using tools of variational analysis and generalized differentiation. Both methods are…

Optimization and Control · Mathematics 2023-04-27 Pham Duy Khanh , Boris Mordukhovich , Vo Thanh Phat , Dat Ba Tran

We propose an adaptive accelerated smoothing technique for a nonsmooth convex optimization problem where the smoothing update rule is coupled with the momentum parameter. We also extend the setting to the case where the objective function…

Optimization and Control · Mathematics 2026-04-21 Reza Rahimi Baghbadorani , Sergio Grammatico , Peyman Mohajerin Esfahani

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

This document introduces a strategy to solve linear optimization problems. The strategy is based on the bounding condition each constraint produces on each one of the problem's dimension. The solution of a linear optimization problem is…

Optimization and Control · Mathematics 2018-09-24 Gerardo L. Febres

This paper presents a convex approach to the optimization of a cooperative rendezvous, that is, the problem of two distant spacecraft that simultaneously operate to get closer. Convex programming guarantees convergence towards the optimal…

Optimization and Control · Mathematics 2020-09-02 Boris Benedikter , Alessandro Zavoli , Guido Colasurdo

In recent years, there has been a surge of interest in studying different ways to reformulate nonconvex optimization problems, especially those that involve binary variables. This interest surge is due to advancements in computing…

Optimization and Control · Mathematics 2026-01-15 Rodolfo A. Quintero , Juan C. Vera , Luis F. Zuluaga

Non-smoothness at optimal points is a common phenomenon in many eigenvalue optimization problems. We consider two recent algorithms to minimize the largest eigenvalue of a Hermitian matrix dependent on one parameter, both proven to be…

Numerical Analysis · Mathematics 2018-05-14 Fatih Kangal , Emre Mengi

Many contemporary signal processing, machine learning and wireless communication applications can be formulated as nonconvex nonsmooth optimization problems. Often there is a lack of efficient algorithms for these problems, especially when…

Information Theory · Computer Science 2017-12-14 Qingjiang Shi , Mingyi Hong , Xiao Fu , Tsung-Hui Chang