English
Related papers

Related papers: Safe Zeroth-Order Optimization Using Linear Progra…

200 papers

This paper presents novel methods to approximate the nonlinear AC optimal power flow (OPF) into tractable linear/quadratic programming (LP/QP) based OPF problems that can be used for power system planning and operation. We derive a linear…

Systems and Control · Computer Science 2019-03-19 Philipp Fortenbacher , Turhan Demiray

Zeroth-order (ZO) optimization has gained attention as a memory-efficient alternative to first-order (FO) methods, particularly in settings where gradient computation is expensive or even impractical. Beyond its memory efficiency, in this…

Machine Learning · Computer Science 2026-03-13 Wanhao Yu , Zheng Wang , Shuteng Niu , Sen Lin , Li Yang

We address black-box convex optimization problems, where the objective and constraint functions are not explicitly known but can be sampled within the feasible set. The challenge is thus to generate a sequence of feasible points converging…

Optimization and Control · Mathematics 2022-11-08 Baiwei Guo , Yuning Jiang , Maryam Kamgarpour , Giancarlo Ferrari-Trecate

Zeroth-order optimization (ZO) has been a powerful framework for solving black-box problems, which estimates gradients using zeroth-order data to update variables iteratively. The practical applicability of ZO critically depends on the…

Optimization and Control · Mathematics 2026-03-03 Ruiyang Jin , Yuke Zhou , Yujie Tang , Jie Song , Siyang Gao

In many real-world problems, first-order (FO) derivative evaluations are too expensive or even inaccessible. For solving these problems, zeroth-order (ZO) methods that only need function evaluations are often more efficient than FO methods…

Optimization and Control · Mathematics 2021-12-22 Zichong Li , Pin-Yu Chen , Sijia Liu , Songtao Lu , Yangyang Xu

The efficacy of large language models (LLMs) in understanding and generating natural language has aroused a wide interest in developing prompt-based methods to harness the power of black-box LLMs. Existing methodologies usually prioritize a…

Artificial Intelligence · Computer Science 2024-03-06 Wenyang Hu , Yao Shu , Zongmin Yu , Zhaoxuan Wu , Xiangqiang Lin , Zhongxiang Dai , See-Kiong Ng , Bryan Kian Hsiang Low

Positive linear programs (LP), also known as packing and covering linear programs, are an important class of problems that bridges computer science, operations research, and optimization. Despite the consistent efforts on this problem, all…

Data Structures and Algorithms · Computer Science 2016-11-15 Zeyuan Allen-Zhu , Lorenzo Orecchia

Fine-tuning large language models (LLMs) using standard first-order (FO) optimization often drives training toward sharp, poorly generalizing minima. Conversely, zeroth-order (ZO) methods offer stronger exploratory behavior without relying…

Machine Learning · Computer Science 2026-01-12 Feihu Jin , Ying Tan

This paper is concerned with optimal power flow (OPF), which is the problem of optimizing the transmission of electricity in power systems. Our main contributions are as follows: (i) we propose a novel parabolic relaxation, which transforms…

Optimization and Control · Mathematics 2018-09-27 Fariba Zohrizadeh , Mohsen Kheirandishfard , Edward Quarm , Ramtin Madani

This paper considers the problem of safe mission planning of dynamic systems operating under uncertain environments. Much of the prior work on achieving robust and safe control requires solving second-order cone programs (SOCP).…

Robotics · Computer Science 2017-02-28 Kai Zhong , Prateek Jain , Ashish Kapoor

Large language models (LLMs) excel across various tasks, but standard first-order (FO) fine-tuning demands considerable memory, significantly limiting real-world deployment. Recently, zeroth-order (ZO) optimization stood out as a promising…

Machine Learning · Computer Science 2025-11-04 Qitao Tan , Jun Liu , Zheng Zhan , Caiwei Ding , Yanzhi Wang , Xiaolong Ma , Jaewoo Lee , Jin Lu , Geng Yuan

This paper proposes a novel and simple linear model to capture line losses for use in linearized DC models, such as optimal power flow (DC-OPF) and security-constrained economic dispatch (SCED). The \textit{Line Loss Outer Approximation}…

Optimization and Control · Mathematics 2021-12-28 Haoruo Zhao , Mathieu Tanneau , Pascal Van Hentenryck

In this paper, we present decomposition techniques for solving large-scale instances of the security-constrained optimal power flow (SCOPF) problem with primary response. Specifically, under each contingency state, we require that the nodal…

Optimization and Control · Mathematics 2019-10-10 Alexandre Velloso , Pascal Van Hentenryck , Emma S. Johnson

This paper introduces a class of model-free feedback methods for solving generic constrained optimization problems where the specific mathematical forms of the objective and constraint functions are not available. The proposed methods,…

Optimization and Control · Mathematics 2025-02-13 Xin Chen , Jorge I. Poveda , Na Li

A fast and scalable iterative methodology for solving the security-constrained optimal power flow (SCOPF) problem is proposed using problem decomposition and the inverse matrix modification lemma. The SCOPF formulation tackles system…

Optimization and Control · Mathematics 2024-07-22 Matias Vistnes , Vijay Venu Vadlamudi , Oddbjørn Gjerde

Zeroth-order optimization (ZO) is a memory-efficient strategy for fine-tuning Large Language Models using only forward passes. However, the application of ZO fine-tuning in memory-constrained settings such as mobile phones and laptops is…

This paper proposes three strong second order cone programming (SOCP) relaxations for the AC optimal power flow (OPF) problem. These three relaxations are incomparable to each other and two of them are incomparable to the standard SDP…

Optimization and Control · Mathematics 2017-06-14 Burak Kocuk , Santanu S. Dey , X. Andy Sun

The security-constrained optimal power flow (SCOPF) is fundamental in power systems and connects the automatic primary response (APR) of synchronized generators with the short-term schedule. Every day, the SCOPF problem is repeatedly solved…

Optimization and Control · Mathematics 2020-07-15 Alexandre Velloso , Pascal Van Hentenryck

An efficient method for computing solutions to the Optimal Transportation (OT) problem with a wide class of cost functions is presented. The standard linear programming (LP) discretization of the continuous problem becomes intractible for…

Numerical Analysis · Mathematics 2015-09-15 Adam M. Oberman , Yuanlong Ruan

Phasor Measurement Units (PMUs) are essential measuring devices for monitoring, control and protection of power systems. The objective of the optimal PMU placement (OPP) problem is to minimize the number of PMUs and select the bus locations…

Optimization and Control · Mathematics 2015-08-25 Nikolaos Theodorakatos , Nikolaos Manousakis , George Korres