English
Related papers

Related papers: An Efficient Numerical Function Optimization Frame…

200 papers

We consider a popular family of constrained optimization problems arising in machine learning that involve optimizing a non-decomposable evaluation metric with a certain thresholded form, while constraining another metric of interest.…

Machine Learning · Computer Science 2021-07-30 Abhishek Kumar , Harikrishna Narasimhan , Andrew Cotter

Tools from control and dynamical systems have proven valuable for analyzing and developing optimization methods. In this paper, we establish rigorous theoretical foundations for using feedback linearization (FL) -- a well-established…

Optimization and Control · Mathematics 2026-01-29 Runyu Zhang , Arvind Raghunathan , Jeff Shamma , Na Li

In this paper, we present a generic framework to extend existing uniformly optimal convex programming algorithms to solve more general nonlinear, possibly nonconvex, optimization problems. The basic idea is to incorporate a local search…

Optimization and Control · Mathematics 2015-10-27 Saeed Ghadimi , Guanghui Lan , Hongchao Zhang

The use of machine learning techniques to improve the performance of branch-and-bound optimization algorithms is a very active area in the context of mixed integer linear problems, but little has been done for non-linear optimization. To…

Many real-life optimization problems frequently contain one or more constraints or objectives for which there are no explicit formulas. If data is however available, these data can be used to learn the constraints. The benefits of this…

Machine Learning · Computer Science 2022-09-23 Adejuyigbe Fajemisin , Donato Maragno , Dick den Hertog

In this paper we present an algorithmic framework for solving a class of combinatorial optimization problems on graphs with bounded pathwidth. The problems are NP-hard in general, but solvable in linear time on this type of graphs. The…

Data Structures and Algorithms · Computer Science 2012-12-18 Mugurel Ionut Andreica

This paper presents a distributed continuous-time optimization framework aimed at overcoming the challenges posed by time-varying cost functions and constraints in multi-agent systems, particularly those subject to disturbances. By…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Zeinab Ebrahimi , Mohammad Deghat

In this paper, we extend a previously presented Grover-based heuristic to tackle general combinatorial optimization problems with linear constraints. We further describe the introduced method as a framework that enables performance…

Quantum Physics · Physics 2025-12-08 Sören Wilkening , Timo Ziegler , Maximilian Hess

We exploit analogies between first-order algorithms for constrained optimization and non-smooth dynamical systems to design a new class of accelerated first-order algorithms for constrained optimization. Unlike Frank-Wolfe or projected…

Optimization and Control · Mathematics 2025-05-02 Michael Muehlebach , Michael I. Jordan

Recent work on Bayesian optimization has shown its effectiveness in global optimization of difficult black-box objective functions. Many real-world optimization problems of interest also have constraints which are unknown a priori. In this…

Machine Learning · Statistics 2014-03-25 Michael A. Gelbart , Jasper Snoek , Ryan P. Adams

Many core problems in robotics can be framed as constrained optimization problems. Often on these problems, the robotic system has uncertainty, or it would be advantageous to identify multiple high quality feasible solutions. To enable…

Robotics · Computer Science 2025-06-03 Griffin Tabor , Tucker Hermans

This paper proposes several novel optimization algorithms for minimizing a nonlinear objective function. The algorithms are enlightened by the optimal state trajectory of an optimal control problem closely related to the minimized objective…

Optimization and Control · Mathematics 2025-04-01 Hongxia Wang , Yeming Xu , Ziyuan Guo , Huanshui Zhang

This study develops a framework for a class of constant modulus (CM) optimization problems, which covers binary constraints, discrete phase constraints, semi-orthogonal matrix constraints, non-negative semi-orthogonal matrix constraints,…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Junbin Liu , Ya Liu , Wing-Kin Ma , Mingjie Shao , Anthony Man-Cho So

A promising approach to optimal control of nonlinear systems involves iteratively linearizing the system and solving an optimization problem at each time instant to determine the optimal control input. Since this approach relies on online…

Optimization and Control · Mathematics 2025-01-30 Anran Li , John P. Swensen , Mehdi Hosseinzadeh

This paper introduces a framework to capture previously intractable optimization constraints and transform them to a mixed-integer linear program, through the use of neural networks. We encode the feasible space of optimization problems…

Systems and Control · Electrical Eng. & Systems 2022-07-15 Ilgiz Murzakhanov , Andreas Venzke , George S. Misyris , Spyros Chatzivasileiadis

This paper presents a framework to solve constrained optimization problems in an accelerated manner based on High-Order Tuners (HT). Our approach is based on reformulating the original constrained problem as the unconstrained optimization…

Optimization and Control · Mathematics 2022-05-27 Anjali Parashar , Priyank Srivastava , Anuradha M. Annaswamy

An algorithm based on the interior-point methodology for solving continuous nonlinearly constrained optimization problems is proposed, analyzed, and tested. The distinguishing feature of the algorithm is that it presumes that only noisy…

Optimization and Control · Mathematics 2025-02-18 Frank E. Curtis , Shima Dezfulian , Andreas Waechter

In this paper, we further investigate and refine the subspace-constrained preconditioning technique to enhance the theoretical and numerical convergence properties of randomized iterative methods for solving linear systems. In particular,…

Numerical Analysis · Mathematics 2026-05-29 Yonghan Sun , Hou-Duo Qi , Deren Han , Jiaxin Xie

Trajectory optimization is a powerful tool for robot motion planning and control. State-of-the-art general-purpose nonlinear programming solvers are versatile, handle constraints effectively and provide a high numerical robustness, but they…

Optimization and Control · Mathematics 2023-07-31 Lander Vanroye , Ajay Sathya , Joris De Schutter , Wilm Decré

This paper studies a class of distributed optimization problems with coupled equality constraints in networked systems. Many existing distributed algorithms rely on solving local subproblems via the $\operatorname{argmin}$ operator in each…

Optimization and Control · Mathematics 2025-11-26 Chenyang Qiu , Zongli Lin