English
Related papers

Related papers: Feedback-Based Optimization with Sub-Weibull Gradi…

200 papers

In this paper, we propose a generic algorithm to train machine learning-based subgrid parametrizations online, i.e., with \textit{a posteriori} loss functions, but for non-differentiable numerical solvers. The proposed approach leverages a…

Computational Physics · Physics 2026-01-14 Hugo Frezat , Ronan Fablet , Guillaume Balarac , Julien Le Sommer

In this paper, online convex optimization is applied to the problem of controlling linear dynamical systems. An algorithm similar to online gradient descent, which can handle time-varying and unknown cost functions, is proposed. Then,…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

The integration of renewables into electrical grids calls for optimization-based control schemes requiring reliable grid models. Classically, parameter estimation and optimization-based control is often decoupled, which leads to high system…

Systems and Control · Electrical Eng. & Systems 2021-03-22 Xu Du , Alexander Engelmann , Timm Faulwasser , Boris Houska

We consider a zeroth-order distributed optimization problem, where the global objective function is a black-box function and, as such, its gradient information is inaccessible to the local agents. Instead, the local agents can only use the…

Optimization and Control · Mathematics 2021-09-29 Yi Shen , Yan Zhang , Scott Nivison , Zachary I. Bell , Michael M. Zavlanos

Gradient boosting is a sequential ensemble method that fits a new weaker learner to pseudo residuals at each iteration. We propose Wasserstein gradient boosting, a novel extension of gradient boosting that fits a new weak learner to…

Methodology · Statistics 2024-08-30 Takuo Matsubara

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

Machine Learning · Statistics 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

We consider the problem of sample-based feedback motion planning from measurements affected by systematic errors. Our previous work presented output feedback controllers that use measurements from landmarks in the environment to navigate…

Robotics · Computer Science 2022-05-17 Mahroo Bahreinian , Roberto Tron

Many optimization methods for training variational quantum algorithms are based on estimating gradients of the cost function. Due to the statistical nature of quantum measurements, this estimation requires many circuit evaluations, which is…

Quantum Physics · Physics 2022-10-14 Lennart Bittel , Jens Watty , Martin Kliesch

Algorithms for bandit convex optimization and online learning often rely on constructing noisy gradient estimates, which are then used in appropriately adjusted first-order algorithms, replacing actual gradients. Depending on the properties…

Machine Learning · Computer Science 2020-07-07 Xiaowei Hu , Prashanth L. A. , András György , Csaba Szepesvári

Energy prices and net power injection limitations regulate the operations in distribution grids and typically ensure that operational constraints are met. Nevertheless, unexpected or prolonged abnormal events could undermine the grid's…

Systems and Control · Electrical Eng. & Systems 2024-03-29 Guido Cavraro , Joshua Comden , Andrey Bernstein

In this work, we revisit a classical distributed gradient-descent algorithm, introducing an interesting class of perturbed multi-agent systems. The state of each subsystem represents a local estimate of a solution to the global optimization…

Optimization and Control · Mathematics 2025-09-04 Tarek Bazizi , Mohamed Maghenem , Paolo Frasca , Antonio Lorìa , Elena Panteley

Online feedback optimization (OFO) enables optimal steady-state operations of a physical system by employing an iterative optimization algorithm as a dynamic feedback controller. When the plant consists of several interconnected…

Optimization and Control · Mathematics 2024-09-13 Wenbin Wang , Zhiyu He , Giuseppe Belgioioso , Saverio Bolognani , Florian Dörfler

We consider a bilevel learning framework for learning linear operators. In this framework, the learnable parameters are optimized via a loss function that also depends on the minimizer of a convex optimization problem (denoted lower-level…

Optimization and Control · Mathematics 2025-06-10 Lea Bogensperger , Matthias J. Ehrhardt , Thomas Pock , Mohammad Sadegh Salehi , Hok Shing Wong

We propose a new stochastic optimization framework for empirical risk minimization problems such as those that arise in machine learning. The traditional approaches, such as (mini-batch) stochastic gradient descent (SGD), utilize an…

Machine Learning · Statistics 2020-02-04 Kenji Kawaguchi , Haihao Lu

In this paper we propose a model-based approach to the design of online optimization algorithms, with the goal of improving the tracking of the solution trajectory (trajectories) w.r.t. state-of-the-art methods. We focus first on quadratic…

Optimization and Control · Mathematics 2023-07-24 Nicola Bastianello , Ruggero Carli , Sandro Zampieri

This paper considers a distributed stochastic non-convex optimization problem, where the nodes in a network cooperatively minimize a sum of $L$-smooth local cost functions with sparse gradients. By adaptively adjusting the stepsizes…

Optimization and Control · Mathematics 2024-04-01 Dongyu Han , Kun Liu , Yeming Lin , Yuanqing Xia

Variational quantum circuits characterise the state of a quantum system through the use of parameters that are optimised using classical optimisation procedures that typically rely on gradient information. The circuit-execution complexity…

Quantum Physics · Physics 2023-07-28 Sayantan Pramanik , Chaitanya Murti , M Girish Chandra

Gradient-based optimization is a key ingredient of variational quantum algorithms, with applications ranging from quantum machine learning to quantum chemistry and simulation. The parameter-shift rule provides a hardware-friendly method for…

Quantum Physics · Physics 2025-10-08 Leonardo Banchi , Dominic Branford , Chetan Waghela

We consider the simultaneous optimization of the reliability and the cost of a ceramic component in a biobjective PDE constrained shape optimization problem. A probabilistic Weibull-type model is used to assess the probability of failure of…

Optimization and Control · Mathematics 2019-07-12 Onur T. Doganay , Hanno Gottschalk , Camilla Hahn , Kathrin Klamroth , Johanna Schultes , Michael Stiglmayr

We develop a maximum likelihood estimating approach for time-to-event Weibull regression models with outcome-dependent sampling, where sampling of subjects is dependent on the residual fraction of the time left to developing the event of…

Applications · Statistics 2014-08-01 Brian D. M. Tom , Vernon T. Farewell , Sheila M. Bird