English
Related papers

Related papers: Nonlinear Derivative-free Constrained Optimization…

200 papers

This article investigates a distributed aggregative optimization problem subject to coupled affine inequality constraints, in which local objective functions depend not only on their own decision variables but also on an aggregation of all…

Optimization and Control · Mathematics 2023-06-13 Kaixin Du , Min Meng

In this work, we consider a distributed online convex optimization problem, with time-varying (potentially adversarial) constraints. A set of nodes, jointly aim to minimize a global objective function, which is the sum of local convex…

Optimization and Control · Mathematics 2021-05-06 Pranay Sharma , Prashant Khanduri , Lixin Shen , Donald J. Bucci , Pramod K. Varshney

We consider an optimal control problem for an abstract nonlinear dissipative evolution equation. The differential constraint is penalized by augmenting the target functional by a nonnegative global-in-time functional which is null-minimized…

Optimization and Control · Mathematics 2019-10-23 Lorenzo Portinale , Ulisse Stefanelli

We introduce a twice differentiable augmented Lagrangian for nonlinear optimization with general inequality constraints and show that a strict local minimizer of the original problem is an approximate strict local solution of the augmented…

Optimization and Control · Mathematics 2021-06-30 Xin-Wei Liu , Yu-Hong Dai , Ya-Kui Huang , Jie Sun

The optimization of parallel kinematic manipulators (PKM) involve several constraints that are difficult to formalize, thus making optimal synthesis problem highly challenging. The presence of passive joint limits as well as the…

Robotics · Computer Science 2022-02-25 Haribhau Durgesh , Guillaume Michel , Shivesh Kumar , Marcello Sanguineti , Damien Chablat

We consider the general nonlinear optimization problem where the objective function has an additional term defined by the $ \ell_0 $-quasi-norm in order to promote sparsity of a solution. This problem is highly difficult due to its…

Optimization and Control · Mathematics 2023-12-27 Christian Kanzow , Felix Weiß

This study investigates imposing hard inequality constraints on the outputs of convolutional neural networks (CNN) during training. Several recent works showed that the theoretical and practical advantages of Lagrangian optimization over…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Hoel Kervadec , Jose Dolz , Jing Yuan , Christian Desrosiers , Eric Granger , Ismail Ben Ayed

In this paper, we propose objective-function-free (OFF) variants of the proximal Newton method for nonconvex composite optimization problems and the regularized Newton method for unconstrained optimization problems, respectively, using…

Optimization and Control · Mathematics 2026-05-19 Hong Zhu

Interior point methods for solving linearly constrained convex programming involve a variable projection matrix at each iteration to deal with the linear constraints. This matrix often becomes ill-conditioned near the boundary of the…

Optimization and Control · Mathematics 2024-12-31 Xun Qian , Li-Zhi Liao , Jie Sun

In equality-constrained optimization, a standard regularity assumption is often associated with feasible point methods, namely the gradients of constraints are linearly independent. In practice, the regularity assumption may be violated. To…

Neural and Evolutionary Computing · Computer Science 2020-03-10 Quan Quan , Kai-Yuan Cai

Direct search methods represent a robust and reliable class of algorithms for solving black-box optimization problems. In this paper, we explore the application of those strategies to Riemannian optimization, wherein minimization is to be…

Optimization and Control · Mathematics 2022-02-23 Vyacheslav Kungurtsev , Francesco Rinaldi , Damiano Zeffiro

We develop an interior-point method for nonsmooth regularized bound-constrained optimization problems. Our method consists of iteratively solving a sequence of unconstrained nonsmooth barrier subproblems. We use a variant of the proximal…

Optimization and Control · Mathematics 2024-02-29 Geoffroy Leconte , Dominique Orban

We address composite optimization problems, which consist in minimizing the sum of a smooth and a merely lower semicontinuous function, without any convexity assumptions. Numerical solutions of these problems can be obtained by proximal…

Optimization and Control · Mathematics 2024-02-14 Alberto De Marchi

This paper proposes and develops new Newton-type methods to solve structured nonconvex and nonsmooth optimization problems with justifying their fast local and global convergence by means of advanced tools of variational analysis and…

Optimization and Control · Mathematics 2026-03-03 Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat

We investigate the existence and uniqueness of (locally) absolutely continuous trajectories of a penalty term-based dynamical system associated to a constrained variational inequality expressed as a monotone inclusion problem. Relying on…

Optimization and Control · Mathematics 2015-03-09 Radu Ioan Bot , Ernö Robert Csetnek

Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic,…

Optimization and Control · Mathematics 2020-07-22 Albert Berahas , Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

We address a problem of covariance selection, where we seek a trade-off between a high likelihood against the number of non-zero elements in the inverse covariance matrix. We solve a maximum likelihood problem with a penalty term given by…

Computational Engineering, Finance, and Science · Computer Science 2007-05-23 Onureena Banerjee , Alexandre d'Aspremont , Laurent El Ghaoui

In this study, we focus on the numerical solution method for the optimal control problem with equilibrium constraints (OCPEC).It is extremely challenging to solve OCPEC owing to the absence of constraint regularity and strictly feasible…

Optimization and Control · Mathematics 2024-05-28 Kangyu Lin , Toshiyuki Ohtsuka

We consider a variable metric linesearch based proximal gradient method for the minimization of the sum of a smooth, possibly nonconvex function plus a convex, possibly nonsmooth term. We prove convergence of this iterative algorithm to a…

Numerical Analysis · Mathematics 2017-04-11 Silvia Bonettini , Ignace Loris , Federica Porta , Marco Prato , Simone Rebegoldi

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban