English
Related papers

Related papers: An adaptive cubic regularisation algorithm based o…

200 papers

In this paper, a class of optimization problems with nonlinear inequality constraints is discussed. Based on the ideas of sequential quadratic programming algorithm and the method of strongly sub-feasible directions, a new superlinearly…

Optimization and Control · Mathematics 2012-06-28 Jin-Bao Jian , Chuan-Hao Guo , Chun-Ming Tang , Yan-Qin Bai

The homogeneous second-order descent method (Zhang et al. 2025, Mathematics of Operations Research) was initially proposed for unconstrained optimisation problems. HSODM shows excellent performance with respect to the global complexity rate…

Optimization and Control · Mathematics 2026-04-08 Yonggang Pei , Yubing Lin , Mauricio Silva Louzeiro , Detong Zhu

The area under the ROC curve (AUC) is a measure of interest in various machine learning and data mining applications. It has been widely used to evaluate classification performance on heavily imbalanced data. The kernelized AUC maximization…

Machine Learning · Computer Science 2019-04-30 Majdi Khalid , Indrakshi Ray , Hamidreza Chitsaz

In this study, we focus on the numerical solution method for the optimal control problem with equilibrium constraints (OCPEC).It is extremely challenging to solve OCPEC owing to the absence of constraint regularity and strictly feasible…

Optimization and Control · Mathematics 2024-05-28 Kangyu Lin , Toshiyuki Ohtsuka

In this work, we develop an adaptive, multivariate partitioning algorithm for solving mixed-integer nonlinear programs (MINLP) with multi-linear terms to global optimality. This iterative algorithm primarily exploits the advantages of…

Optimization and Control · Mathematics 2019-02-05 Harsha Nagarajan , Mowen Lu , Site Wang , Russell Bent , Kaarthik Sundar

Although the classical LQR design method has been very successful in real world engineering designs, in some cases, the classical design method needs modifications because of the saturation in actuators. This modified problem is sometimes…

Optimization and Control · Mathematics 2022-09-13 Yaguang Yang

Momentum is a popular technique to accelerate the convergence in practical training, and its impact on convergence guarantee has been well-studied for first-order algorithms. However, such a successful acceleration technique has not yet…

Optimization and Control · Mathematics 2019-06-28 Zhe Wang , Yi Zhou , Yingbin Liang , Guanghui Lan

This work presents an adaptive superfast proximal augmented Lagrangian (AS-PAL) method for solving linearly-constrained smooth nonconvex composite optimization problems. Each iteration of AS-PAL inexactly solves a possibly nonconvex…

Optimization and Control · Mathematics 2022-10-07 Arnesh Sujanani , Renato D. C. Monteiro

The problem of finding a vector with the fewest nonzero elements that satisfies an underdetermined system of linear equations is an NP-complete problem that is typically solved numerically via convex heuristics or nicely-behaved non convex…

Optimization and Control · Mathematics 2012-05-03 Heinz H. Bauschke , D. Russell Luke , Hung M. Phan , Xianfu Wang

A novel inner approximation algorithm is proposed for dynamic optimization problems to ensure strict satisfaction of path constraints. Distinct from traditional methods relying on interval analysis, the proposed algorithm leverages the…

Optimization and Control · Mathematics 2026-02-10 Yuan Chang , Lizhong Jiang , Tai-Fang Li , Jun Fu

We propose and analyse primal-dual interior-point algorithms for convex optimization problems in conic form. The families of algorithms we analyse are so-called short-step algorithms and they match the current best iteration complexity…

Optimization and Control · Mathematics 2014-11-11 Tor Myklebust , Levent Tunçel

In many applications, we need algorithms which can align partially overlapping point sets and are invariant to the corresponding transformations. In this work, a method possessing such properties is realized by minimizing the objective of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Wei Lian , Wangmeng Zuo

We propose an implicit iterative algorithm for an exact penalty method arising from inequality constrained optimization problems. A rapidly convergent fixed point method is developed for a regularized penalty functional. The applicability…

Optimization and Control · Mathematics 2012-10-05 Kazufumi Ito , Tomoya Takeuchi

This paper presents the development and analysis of an asymptotically compatible (AC) unfitted finite element method for one-dimensional nonlocal elliptic interface problems. The proposed method achieves optimal error estimates through…

Numerical Analysis · Mathematics 2025-12-23 Haixia Dong , Ziqing Xie , Jiwei Zhang

Quantum relative entropy optimization refers to a class of convex problems in which a linear functional is minimized over an affine section of the epigraph of the quantum relative entropy function. Recently, the self-concordance of a…

Quantum Physics · Physics 2025-04-22 Kerry He , James Saunderson , Hamza Fawzi

In this paper, we develop a unified framework able to certify both exponential and subexponential convergence rates for a wide range of iterative first-order optimization algorithms. To this end, we construct a family of parameter-dependent…

Optimization and Control · Mathematics 2018-02-26 Mahyar Fazlyab , Alejandro Ribeiro , Manfred Morari , Victor M. Preciado

In this paper, we consider the nonlinear constrained optimization problem (NCP) with constraint set $\{x \in \mathcal{X}: c(x) = 0\}$, where $\mathcal{X}$ is a closed convex subset of $\mathbb{R}^n$. We propose an exact penalty approach,…

Optimization and Control · Mathematics 2025-05-06 Nachuan Xiao , Tianyun Tang , Shiwei Wang , Kim-Chuan Toh

Nonlinear adaptive filters often show some sparse behavior due to the fact that not all the coefficients are equally useful for the modeling of any nonlinearity. Recently, a class of proportionate algorithms has been proposed for nonlinear…

Signal Processing · Electrical Eng. & Systems 2022-12-16 Danilo Comminiello , Michele Scarpiniti , Simone Scardapane , Luis A. Azpicueta-Ruiz , Aurelio Uncini

Decentralized optimization algorithms are important in different contexts, such as distributed optimal power flow or distributed model predictive control, as they avoid central coordination and enable decomposition of large-scale problems.…

Optimization and Control · Mathematics 2019-03-28 Alexander Engelmann , Yuning Jiang , Boris Houska , Timm Faulwasser

We prove that the classic logarithmic barrier problem is equivalent to a particular logarithmic barrier positive relaxation problem with barrier and scaling parameters. Based on the equivalence, a line-search primal-dual interior-point…

Optimization and Control · Mathematics 2018-07-10 Xin-Wei Liu , Yu-Hong Dai