English
Related papers

Related papers: Robust Hybrid Zero-Order Optimization Algorithms w…

200 papers

This paper develops a sliding mode control based frame work for equality constrained optimization by reformulation the first order Karush Kuhn Tucker conditions as control affine dynamical system. The optimization variables are treated as…

Optimization and Control · Mathematics 2026-05-01 Shyam Kamal , Baby Diana , Sunidhi Pandey , Sandip Ghosh , Thach Ngoc Dinh

In this paper, we study zeroth-order algorithms for nonconvex minimax problems with coupled linear constraints under the deterministic and stochastic settings, which have attracted wide attention in machine learning, signal processing and…

Optimization and Control · Mathematics 2026-03-06 Huiling Zhang , Zi Xu , Yuhong Dai

Many systems exhibit a mixture of continuous and discrete dynamics. We consider a family of mixed-integer non-convex non-linear optimisation problems obtained in discretisations of optimal control of such systems. For this family, a…

Optimization and Control · Mathematics 2020-01-23 Jorn Baayen , Jakub Marecek

We introduce a generic scheme for accelerating first-order optimization methods in the sense of Nesterov, which builds upon a new analysis of the accelerated proximal point algorithm. Our approach consists of minimizing a convex objective…

Optimization and Control · Mathematics 2015-10-27 Hongzhou Lin , Julien Mairal , Zaid Harchaoui

Distributionally robust optimization (DRO) is a widely-used approach to learn models that are robust against distribution shift. Compared with the standard optimization setting, the objective function in DRO is more difficult to optimize,…

Machine Learning · Computer Science 2021-10-27 Jikai Jin , Bohang Zhang , Haiyang Wang , Liwei Wang

As a core part of autonomous driving systems, motion planning has received extensive attention from academia and industry. However, real-time trajectory planning capable of spatial-temporal joint optimization is challenged by nonholonomic…

Robotics · Computer Science 2023-04-11 Zhichao Han , Yuwei Wu , Tong Li , Lu Zhang , Liuao Pei , Long Xu , Chengyang Li , Changjia Ma , Chao Xu , Shaojie Shen , Fei Gao

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

We investigate accelerated zeroth-order algorithms for smooth composite convex optimization problems. While for unconstrained optimization, existing methods that merge 2-point zeroth-order gradient estimators with first-order frameworks…

Optimization and Control · Mathematics 2024-07-15 Silan Zhang , Yujie Tang

$ $In many optimization problems, a feasible solution induces a multi-dimensional cost vector. For example, in load-balancing a schedule induces a load vector across the machines. In $k$-clustering, opening $k$ facilities induces an…

Data Structures and Algorithms · Computer Science 2018-11-14 Deeparnab Chakrabarty , Chaitanya Swamy

In this paper, through a very intuitive vanilla proximal method perspective, we derive accelerated high-order optimization algorithms for minimizing a convex function that has H\"{o}lder continuous derivatives. In this general convex…

Optimization and Control · Mathematics 2019-10-01 Chaobing Song , Yong Jiang , Yi Ma

The Hybrid Online Learning Problem, where features are drawn i.i.d. from an unknown distribution but labels are generated adversarially, is a well-motivated setting positioned between statistical and fully-adversarial online learning. Prior…

Machine Learning · Computer Science 2026-03-06 Princewill Okoroafor , Robert Kleinberg , Michael P. Kim

Necessary conditions for high-order optimality in smooth nonlinear constrained optimization are explored and their inherent intricacy discussed. A two-phase minimization algorithm is proposed which can achieve approximate first-, second-…

Optimization and Control · Mathematics 2021-05-31 C. Cartis , N. I. M. Gould , Ph. L. Toint

This paper presents a novel robust trajectory optimization method for constrained nonlinear dynamical systems subject to unknown bounded disturbances. In particular, we seek optimal control policies that remain robustly feasible with…

Systems and Control · Electrical Eng. & Systems 2025-04-08 Arshiya Taj Abdul , Augustinos D. Saravanos , Evangelos A. Theodorou

We present a centralized algorithmic framework for solving multi-robot path planning problems in general, two-dimensional, continuous environments while minimizing globally the task completion time. The framework obtains high levels of…

Robotics · Computer Science 2015-07-14 Jingjin Yu , Daniela Rus

Motivated by a real problem in steel production, we introduce and analyze a general class of singularly perturbed linear hybrid systems with both switches and impulses, in which the slow or fast nature of the variables can be…

Systems and Control · Computer Science 2017-06-16 Jihene Ben Rejeb , Irinel-Constantin Morărescu , Antoine Girard , Jamal Daafouz

We consider a class of multi-agent cooperative consensus optimization problems with local nonlinear convex constraints where only those agents connected by an edge can directly communicate, hence, the optimal consensus decision lies in the…

Optimization and Control · Mathematics 2023-02-23 Nazanin Abolfazli , Afrooz Jalilzadeh , Erfan Yazdandoost Hamedani

Submodular optimization generalizes many classic problems in combinatorial optimization and has recently found a wide range of applications in machine learning (e.g., feature engineering and active learning). For many large-scale…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

In this contribution we develop an efficient reduced order model for solving parametrized linear-quadratic optimal control problems with linear time-varying state system. The fully reduced model combines reduced basis approximations of the…

Numerical Analysis · Mathematics 2024-08-29 Hendrik Kleikamp , Lukas Renelt

Constrained optimization problems are ubiquitous in science and industry. Quantum algorithms have shown promise in solving optimization problems, yet none of the current algorithms can effectively handle arbitrary constraints. We introduce…

We propose a new framework to design and analyze accelerated methods that solve general monotone equation (ME) problems $F(x)=0$. Traditional approaches include generalized steepest descent methods and inexact Newton-type methods. If $F$ is…

Optimization and Control · Mathematics 2024-07-22 Tianyi Lin , Michael. I. Jordan