English
Related papers

Related papers: Potentialities of Nonsmooth Optimization

200 papers

This paper investigates the behavior of sets and functions at infinity by introducing new concepts, namely directional normal cones at infinity for unbounded sets, along with limiting and singular subdifferentials at infinity in the…

Optimization and Control · Mathematics 2025-10-13 Le Ngoc Kien , Nguyen Van Tuyen , Tran Van Nghi

We introduce a discrete-time fractional calculus of variations. First and second order necessary optimality conditions are established. Examples illustrating the use of the new Euler-Lagrange and Legendre type conditions are given. They…

Optimization and Control · Mathematics 2010-10-28 Nuno R. O. Bastos , Rui A. C. Ferreira , Delfim F. M. Torres

This paper considers the distributed smooth optimization problem in which the objective is to minimize a global cost function formed by a sum of local smooth cost functions, by using local information exchange. The standard assumption for…

Optimization and Control · Mathematics 2019-09-10 Xinlei Yi , Shengjun Zhang , Tao Yang , Karl H. Johansson , Tianyou Chai

Motivated by the optimality principles for non-subdifferentiable optimization problems, we introduce new relative subdifferentials and examine some properties for relatively lower semicontinuous functions including $\epsilon$-regular…

Optimization and Control · Mathematics 2024-10-15 Vo Duc Thinh , Thai Doan Chuong , Xiaolong Qin

We focus on nonconvex and nonsmooth minimization problems with a composite objective, where the differentiable part of the objective is freed from the usual and restrictive global Lipschitz gradient continuity assumption. This longstanding…

Optimization and Control · Mathematics 2017-06-21 Jérôme Bolte , Shoham Sabach , Marc Teboulle , Yakov Vaisbourd

We present a stochastic setting for optimization problems with nonsmooth convex separable objective functions over linear equality constraints. To solve such problems, we propose a stochastic Alternating Direction Method of Multipliers…

Machine Learning · Computer Science 2013-01-23 Hua Ouyang , Niao He , Alexander Gray

To tackle difficulties for theoretical studies in situations involving nonsmooth functions, we propose a sequence of infinitely differentiable functions to approximate the nonsmooth function under consideration. A rate of approximation is…

Econometrics · Economics 2023-09-29 Chaohua Dong , Jiti Gao , Bin Peng , Yundong Tu

We consider the problem of global optimization of an unknown non-convex smooth function with zeroth-order feedback. In this setup, an algorithm is allowed to adaptively query the underlying function at different locations and receives noisy…

Machine Learning · Statistics 2018-03-26 Yining Wang , Sivaraman Balakrishnan , Aarti Singh

The directional subdifferential of the value function gives an estimate on how much the optimal value changes under a perturbation in a certain direction. In this paper we derive upper estimates for the directional limiting and singular…

Optimization and Control · Mathematics 2023-04-19 Kuang Bai , Jane J. Ye

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

It is well-known that every convex function admits an affine support at every interior point of a domain. Convex functions of higher order (precisely of an odd order) have a similar property: they are supported by the polynomials of degree…

Functional Analysis · Mathematics 2008-07-28 Szymon Wasowicz

We consider the problem of optimizing the sum of a smooth, nonconvex function for which derivatives are unavailable, and a convex, nonsmooth function with easy-to-evaluate proximal operator. Of particular focus is the case where the smooth…

Optimization and Control · Mathematics 2024-07-23 Yanjun Liu , Kevin H. Lam , Lindon Roberts

A cutting-plane model for a nonsmooth function is the maximum of several first-order expansions centered at different points. Using such a model in a bundle method leads to linear convergence (of serious steps) to a minimum. In smooth…

Optimization and Control · Mathematics 2026-03-26 Bennet Gebken , Michael Ulbrich

We establish or refute the optimality of inexact second-order methods for unconstrained nonconvex optimization from the point of view of worst-case evaluation complexity, improving and generalizing the results of Cartis, Gould and Toint…

Optimization and Control · Mathematics 2021-05-31 Coralia Cartis , Nick I. M. Gould , Philippe L. Toint

This article develops optimality conditions for a large class of non-smooth variational models. The main results are based on standard tools of functional analysis and calculus of variations. Firstly we address a model with equality…

Functional Analysis · Mathematics 2023-01-23 Fabio Silva Botelho

To overcome the weakness of a total variation based model for image restoration, various high order (typically second order) regularization models have been proposed and studied recently. In this paper we analyze and test a fractional-order…

Computer Vision and Pattern Recognition · Computer Science 2015-09-15 Jianping Zhang , Ke Chen

We propose a new family of adaptive first-order methods for a class of convex minimization problems that may fail to be Lipschitz continuous or smooth in the standard sense. Specifically, motivated by a recent flurry of activity on…

Optimization and Control · Mathematics 2021-07-19 Kimon Antonakopoulos , Panayotis Mertikopoulos

We study the complexity of producing $(\delta,\epsilon)$-stationary points of Lipschitz objectives which are possibly neither smooth nor convex, using only noisy function evaluations. Recent works proposed several stochastic zero-order…

Optimization and Control · Mathematics 2024-04-16 Guy Kornowski , Ohad Shamir

We obtain Euler-Lagrange and transversality optimality conditions for higher-order infinite horizon variational problems on a time scale. The new necessary optimality conditions improve the classical results both in the continuous and…

Optimization and Control · Mathematics 2012-11-13 Natalia Martins , Delfim F. M. Torres

This paper deals with generalized differentiability and second-order necessary optimality conditions for a box-constrained optimal control problem governed by an exponential semilinear elliptic equation with discrete measures as sources,…

Optimization and Control · Mathematics 2026-05-20 Vu Huu Nhu , Nguyen Hai Son , Phan Quang Sang , Tran Duy