English
Related papers

Related papers: A Levenberg-Marquardt Method for Nonsmooth Regular…

200 papers

We propose several new nonsmooth Newton methods for solving convex composite optimization problems with polyhedral regularizers, while avoiding the computation of complicated second-order information on these functions. Under the…

Optimization and Control · Mathematics 2025-11-25 Tran T. A. Nghia , Nghia V. Vo , Khoa V. H. Vu

Optimization problems with composite functions consist of an objective function which is the sum of a smooth and a (convex) nonsmooth term. This particular structure is exploited by the class of proximal gradient methods and some of their…

Optimization and Control · Mathematics 2022-10-17 Christian Kanzow , Theresa Lechner

In these notes we propose and analyze an inertial type method for obtaining stable approximate solutions to nonlinear ill-posed operator equations. The method is based on the Levenberg-Marquardt (LM) iteration. The main obtained results…

Numerical Analysis · Mathematics 2024-06-12 Antonio Leitão , Joel C. Rabelo , Dirk A. Lorenz , Maximilian Winkler

In this paper, we provide near-optimal accelerated first-order methods for minimizing a broad class of smooth nonconvex functions that are strictly unimodal on all lines through a minimizer. This function class, which we call the class of…

Optimization and Control · Mathematics 2023-02-27 Oliver Hinder , Aaron Sidford , Nimit S. Sohoni

A low-order nonconforming finite element discretization of a smooth de Rham complex starting from the $H^2$ space in three dimensions is proposed, involving an $H^2$-nonconforming finite element space, a new tangentially continuous…

Numerical Analysis · Mathematics 2025-12-05 Xuewei Cui , Xuehai Huang

First-order optimization methods are crucial for solving large-scale data processing problems, particularly those involving convex non-smooth composite objectives. For such problems with convex non-smooth composite objectives, we introduce…

Optimization and Control · Mathematics 2025-10-06 Endrit Dosti , Sergiy A. Vorobyov , Themistoklis Charalambous

This paper addresses a class of general nonsmooth and nonconvex composite optimization problems subject to nonlinear equality constraints. We assume that a part of the objective function and the functional constraints exhibit local…

Optimization and Control · Mathematics 2025-03-04 Lahcen El Bourkhissi , Ion Necoara , Panagiotis Patrinos , Quoc Tran-Dinh

Convex and nonconvex finite-sum minimization arises in many scientific computing and machine learning applications. Recently, first-order and second-order methods where objective functions, gradients and Hessians are approximated by…

Optimization and Control · Mathematics 2020-05-12 Stefania Bellavia , Natasa Krejic , Benedetta Morini

We propose a novel study of the stochastic proximal gradient method for minimizing the sum of two convex functions, one of which is smooth. Under suitable assumptions and without requiring any boundedness or control of the variance of the…

Optimization and Control · Mathematics 2026-04-16 Javier I. Madariaga

In this paper, we consider a broad class of nonsmooth and nonconvex fractional programs, where the numerator can be written as the sum of a continuously differentiable convex function whose gradient is Lipschitz continuous and a proper…

Optimization and Control · Mathematics 2022-01-19 Radu Ioan Boţ , Minh N. Dao , Guoyin Li

This paper is concerned with $\ell_q\,(0<q<1)$-norm regularized minimization problems with a twice continuously differentiable loss function. For this class of nonconvex and nonsmooth composite problems, many algorithms have been proposed…

Optimization and Control · Mathematics 2023-06-27 Yuqia Wu , Shaohua Pan , Xiaoqi Yang

This paper analyzes block-coordinate proximal gradient methods for minimizing the sum of a separable smooth function and a (nonseparable) nonsmooth function, both of which are allowed to be nonconvex. The main tool in our analysis is the…

Optimization and Control · Mathematics 2024-04-17 Puya Latafat , Andreas Themelis , Panagiotis Patrinos

We develop a method for offline parameter estimation of discrete multibody dynamics with regularized and frictional kinematic constraints. This setting leads to unobserved degrees of freedom, which we handle using joint state and parameter…

Optimization and Control · Mathematics 2025-02-11 Hannes Marklund , Martin Servin , Mats G Larson

We consider a class of nonconvex nonsmooth optimization problems whose objective is the sum of a smooth function and a finite number of nonnegative proper closed possibly nonsmooth functions (whose proximal mappings are easy to compute),…

Optimization and Control · Mathematics 2018-05-29 Tianxiang Liu , Ting Kei Pong , Akiko Takeda

An algorithm is proposed, analyzed, and tested for minimizing locally Lipschitz objective functions that may be nonconvex and/or nonsmooth. The algorithm, which is built upon the gradient-sampling methodology, is designed specifically for…

Optimization and Control · Mathematics 2026-04-02 Albert S. Berahas , Frank E. Curtis , Lara Zebiane

We study the performance of a family of randomized parallel coordinate descent methods for minimizing the sum of a nonsmooth and separable convex functions. The problem class includes as a special case L1-regularized L1 regression and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-24 Olivier Fercoq , Peter Richtárik

In this paper, a well-posed simultaneous space-time First Order System Least Squares formulation is constructed of the instationary incompressible Stokes equations with slip boundary conditions. As a consequence of this well-posedness, the…

Numerical Analysis · Mathematics 2022-08-24 Gregor Gantner , Rob Stevenson

This paper concerns the composite problem of minimizing the sum of a twice continuously differentiable function $f$ and a nonsmooth convex function. For this class of nonconvex and nonsmooth problems, by leveraging a practical inexactness…

Optimization and Control · Mathematics 2025-05-27 Ruyu Liu , Shaohua Pan , Yitian Qian

The robust adjustment of nonlinear models to data is considered in this paper. When data comes from real experiments, it is possible that measurement errors cause the appearance of discrepant values, which should be ignored when adjusting…

Optimization and Control · Mathematics 2019-12-02 E. V. Castelani , R. Lopes , W. V. I. Shirabayashi , F. N. C. Sobral

Trajectory design in cislunar space under a High-Fidelity Ephemeris Model (HFEM) is pursued through a nonlinear optimization perspective anchored on the transition of solutions from lower fidelity models, namely the Circular Restricted…

Optimization and Control · Mathematics 2026-03-27 António Nunes , Sérgio Brás , Pedro Batista , João Xavier