English
Related papers

Related papers: Efficient Zero-Order Robust Optimization for Real-…

200 papers

We study novel robust zero-order algorithms with acceleration for the solution of real-time optimization problems. In particular, we propose a family of extremum seeking dynamics that can be universally modeled as singularly perturbed…

Optimization and Control · Mathematics 2020-12-17 Jorge I. Poveda , Na Li

In this paper, we study the standard formulation of an optimization problem when the computation of gradient is not available. Such a problem can be classified as a "black box" optimization problem, since the oracle returns only the value…

Optimization and Control · Mathematics 2024-09-30 Aleksandr Lobanov , Nail Bashirov , Alexander Gasnikov

Robust Optimal Control (ROC) with adjustable uncertainties has proven to be effective in addressing critical challenges within modern energy networks, especially the reserve and provision problem. However, prior research on ROC with…

Systems and Control · Electrical Eng. & Systems 2023-12-19 Yun Li , Neil Yorke-Smith , Tamas Keviczky

Zeroth-Order optimization presents a promising memory-efficient paradigm for fine-tuning Large Language Models by relying solely on forward passes. However, its practical adoption is severely constrained by slow wall-clock convergence and…

Machine Learning · Computer Science 2026-04-21 Fei Wang , Li Shen , Liang Ding , Chao Xue , Ye Liu , Changxing Ding

A major challenge of applying zeroth-order (ZO) methods is the high query complexity, especially when queries are costly. We propose a novel gradient estimation technique for ZO methods based on adaptive lazy queries that we term as LAZO.…

Machine Learning · Computer Science 2022-06-16 Quan Xiao , Qing Ling , Tianyi Chen

Distributionally Robust Optimization (DRO) is a worst-case approach to decision making when there is model uncertainty. It is also well known that for certain uncertainty sets, DRO is approximated by a regularized nominal problem. We show…

Optimization and Control · Mathematics 2026-05-08 Jun-ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

Optimization and Control · Mathematics 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan

To solve unmodeled optimization problems with hard constraints, this paper proposes a novel zeroth-order approach called Safe Zeroth-order Optimization using Linear Programs (SZO-LP). The SZO-LP method solves a linear program in each…

Optimization and Control · Mathematics 2023-04-05 Baiwei Guo , Yang Wang , Yuning Jiang , Maryam Kamgarpour , Giancarlo Ferrari-Trecate

Interest in derivative-free optimization (DFO) and "evolutionary strategies" (ES) has recently surged in the Reinforcement Learning (RL) community, with growing evidence that they can match state of the art methods for policy optimization…

In order to protect the environment and address fossil fuel scarcity, renewable energy is increasingly used for power generation. However, due to the uncertainties it brings to electricity production, deterministic optimization is no longer…

Optimization and Control · Mathematics 2022-12-13 Shuhan Lyu

In cell-free massive multiple-input multiple-output (MIMO) networks, robust resource allocation is critical to ensure reliable system performance in the presence of channel uncertainties resulting from imperfect channel state information…

Information Theory · Computer Science 2026-01-27 Saeed Mashdour , Saeed Mohammadzadeh , André R. Flores , Shirin Salehi , Rodrigo C. de Lamare , Anke Schmeink

The goal of robust constrained reinforcement learning (RL) is to optimize an agent's performance under the worst-case model uncertainty while satisfying safety or resource constraints. In this paper, we demonstrate that strong duality does…

Machine Learning · Computer Science 2025-09-23 Shaocong Ma , Ziyi Chen , Yi Zhou , Heng Huang

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

Optimization and Control · Mathematics 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

Robust optimization (RO) has emerged as one of the leading paradigms to efficiently model parameter uncertainty. The recent connections between RO and problems in statistics and machine learning domains demand for solving RO problems in…

Optimization and Control · Mathematics 2017-11-21 Nam Ho-Nguyen , Fatma Kilinc-Karzan

Multicriteria adjustable robust optimization (MARO) problems arise in a wide variety of practical settings, for example, in the design of a building's energy supply. However, no general approaches, neither for the characterization of…

Optimization and Control · Mathematics 2024-06-13 Elisabeth Halser , Elisabeth Finhold , Neele Leithäuser , Jan Schwientek , Katrin Teichert , Karl-Heinz Küfer

The minimax excess risk optimization (MERO) problem is a new variation of the traditional distributionally robust optimization (DRO) problem, which achieves uniformly low regret across all test distributions under suitable conditions. In…

Optimization and Control · Mathematics 2024-08-23 Zhihao Gu , Zi Xu

Clustering consists of grouping together samples giving their similar properties. The problem of modeling simultaneously groups of samples and features is known as Co-Clustering. This paper introduces ROCCO - a Robust Continuous…

Machine Learning · Computer Science 2018-02-15 Xiao He , Luis Moreira-Matias

We study piecewise affine policies for multi-stage adjustable robust optimization (ARO) problems with non-negative right-hand side uncertainty. First, we construct new dominating uncertainty sets and show how a multi-stage ARO problem can…

Optimization and Control · Mathematics 2024-02-06 Simon Thomä , Grit Walther , Maximilian Schiffer

This paper investigates the stochastic distributed nonconvex optimization problem of minimizing a global cost function formed by the summation of $n$ local cost functions. We solve such a problem by involving zeroth-order (ZO) information…

Optimization and Control · Mathematics 2021-10-15 Shengjun Zhang , Yunlong Dong , Dong Xie , Lisha Yao , Colleen P. Bailey , Shengli Fu

A novel distributed algorithm is proposed for finite-time converging to a feasible consensus solution satisfying global optimality to a certain accuracy of the distributed robust convex optimization problem (DRCO) subject to bounded…

Optimization and Control · Mathematics 2023-09-06 Xunhao Wu , Jun Fu