English
Related papers

Related papers: First-order differentiability properties of a clas…

200 papers

We provide a generalization of first-order necessary conditions of optimality for infinite-dimensional optimization problems with a finite number of inequality constraints and with a finite number of inequality and equality constraints. Our…

Optimization and Control · Mathematics 2020-01-22 Hasan Yilmaz

We propose first order algorithms for convex optimization problems where the feasible set is described by a large number of convex inequalities that is to be explored by subgradient projections. The first algorithm is an adaptation of a…

Optimization and Control · Mathematics 2015-06-30 C. H. Jeffrey Pang

The paper is devoted to obtain first and second order necessary optimality conditions for continuous-time optimization problems with equality and inequality constraints. A full rank type regularity condition along with an uniform implicit…

Optimization and Control · Mathematics 2023-05-10 Moisés Rodrigues Cirilo do Monte , Valeriano Antunes de Oliveira

We focus on nonconvex and nonsmooth minimization problems with a composite objective, where the differentiable part of the objective is freed from the usual and restrictive global Lipschitz gradient continuity assumption. This longstanding…

Optimization and Control · Mathematics 2017-06-21 Jérôme Bolte , Shoham Sabach , Marc Teboulle , Yakov Vaisbourd

We present a new algorithm for solving optimization problems with objective functions that are the sum of a smooth function and a (potentially) nonsmooth regularization function, and nonlinear equality constraints. The algorithm may be…

Optimization and Control · Mathematics 2024-04-12 Yutong Dai , Xiaoyi Qu , Daniel P. Robinson

The paper is devoted to the study of the twice epi-differentiablity of extended-real-valued functions, with an emphasis on functions satisfying a certain composite representation. This will be conducted under the parabolic regularity, a…

Optimization and Control · Mathematics 2020-04-15 Ashkan Mohammadi , M. Ebrahim Sarabi

These notes focus on the minimization of convex functionals using first-order optimization methods, which are fundamental in many areas of applied mathematics and engineering. The primary goal of this document is to introduce and analyze…

Optimization and Control · Mathematics 2024-10-28 Charles Dossal , Samuel Hurault , Nicolas Papadakis

The usual approach to developing and analyzing first-order methods for smooth convex optimization assumes that the gradient of the objective function is uniformly smooth with some Lipschitz constant $L$. However, in many settings the…

Optimization and Control · Mathematics 2017-10-11 Haihao Lu , Robert M. Freund , Yurii Nesterov

We introduce \textit{basic inequalities} for first-order iterative optimization algorithms, forming a simple and versatile framework that connects implicit and explicit regularization. While related inequalities appear in the literature, we…

Statistics Theory · Mathematics 2026-01-01 Seunghoon Paik , Kangjie Zhou , Matus Telgarsky , Ryan J. Tibshirani

A regularization algorithm using inexact function values and inexact derivatives is proposed and its evaluation complexity analyzed. This algorithm is applicable to unconstrained problems and to problems with inexpensive constraints (that…

Optimization and Control · Mathematics 2019-04-22 S. Bellavia , G. Gurioli , B. Morini , Ph. L. Toint

We consider shape optimization problems subject to elliptic partial differential equations. In the context of the finite element method, the geometry to be optimized is represented by the computational mesh, and the optimization proceeds by…

Optimization and Control · Mathematics 2019-07-12 Tommy Etling , Roland Herzog , Estefanía Loayza , Gerd Wachsmuth

Many modern machine learning applications, such as multi-task learning, require finding optimal model parameters to trade-off multiple objective functions that may conflict with each other. The notion of the Pareto set allows us to focus on…

Optimization and Control · Mathematics 2022-09-05 Mao Ye , Qiang Liu

We develop further the theory of symmetrization of fractional Laplacian operators contained in recent works of two of the authors. The theory leads to optimal estimates in the form of concentration comparison inequalities for both elliptic…

Analysis of PDEs · Mathematics 2015-06-25 Yannick Sire , Juan Luis Vazquez , Bruno Volzone

This paper investigates a specific class of nonsmooth nonconvex optimization problems in the face of data uncertainty, namely, robust optimization problems, where the given objective function can be expressed as a difference of two…

Optimization and Control · Mathematics 2026-02-20 Feryal Mashkoorzadeh , Nooshin Movahedian

An adaptive regularization algorithm using high-order models is proposed for partially separable convexly constrained nonlinear optimization problems whose objective function contains non-Lipschitzian $\ell_q$-norm regularization terms for…

Optimization and Control · Mathematics 2021-05-31 Xiaojun Chen , Philippe Toint , Hong Wang

This paper is devoted to the study of the second-order variational analysis of spectral functions. It is well-known that spectral functions can be expressed as a composite function of symmetric functions and eigenvalue functions. We…

Optimization and Control · Mathematics 2024-05-06 Ashkan Mohammadi , Ebrahim Sarabi

The paper studies coincidence points of parameterized set-valued mappings (multifunctions), which provide an extended framework to cover several important topics in variational analysis and optimization that include the existence of…

Optimization and Control · Mathematics 2022-03-23 Aram V. Arutyunov , Boris S. Mordukhovich , Sergey E. Zhukovskiy

In this paper, we develop a functional differentiability approach for solving statistical optimal allocation problems. We derive Hadamard differentiability of the value functions through analyzing the properties of the sorting operator…

Econometrics · Economics 2026-02-24 Kai Feng , Han Hong , Denis Nekipelov

The paper addresses parametric inequality systems described by polynomial functions in finite dimensions, where state-dependent infinite parameter sets are given by finitely many polynomial inequalities and equalities. Such systems can be…

Optimization and Control · Mathematics 2015-09-15 G. Li , B. S. Mordukhovich , T. T. A. Nghia , T. S. Pham

The aim of the paper is to show that the solutions to variational problems with non-standard growth conditions satisfy a corresponding variational inequality without any smallness assumptions on the gap between growth and coercitivity…

Analysis of PDEs · Mathematics 2020-10-09 Michela Eleuteri , Antonia Passarelli di Napoli