中文
相关论文

相关论文: On Controller Tuning with Time-Varying Bayesian Op…

200 篇论文

This paper investigates the problem of regulating in real time a linear dynamical system to the solution trajectory of a time-varying constrained convex optimization problem. The proposed feedback controller is based on an adaptation of the…

最优化与控制 · 数学 2021-09-13 Gianluca Bianchin , Jorge Cortes , Jorge I. Poveda , Emiliano Dall'Anese

Online field experiments are the gold-standard way of evaluating changes to real-world interactive machine learning systems. Yet our ability to explore complex, multi-dimensional policy spaces - such as those found in recommendation and…

机器学习 · 统计学 2019-04-30 Benjamin Letham , Eytan Bakshy

This paper considers a time-varying optimization problem associated with a network of systems, with each of the systems shared by (and affecting) a number of individuals. The objective is to minimize cost functions associated with the…

最优化与控制 · 数学 2022-03-15 Ana M. Ospina , Andrea Simonetto , Emiliano Dall'Anese

Many machine learning models require a training procedure based on running stochastic gradient descent. A key element for the efficiency of those algorithms is the choice of the learning rate schedule. While finding good learning rates…

机器学习 · 统计学 2020-06-26 Victor Picheny , Vincent Dutordoir , Artem Artemev , Nicolas Durrande

In the past few years, Online Convex Optimization (OCO) has received notable attention in the control literature thanks to its flexible real-time nature and powerful performance guarantees. In this paper, we propose new step-size rules and…

最优化与控制 · 数学 2023-01-18 Pedro Zattoni Scroccaro , Arman Sharifi Kolarijani , Peyman Mohajerin Esfahani

This paper studies the design of feedback controllers to steer a switching linear time-invariant dynamical system towards the solution trajectory of a time-varying convex optimization problem. We propose two types of controllers: (i) a…

最优化与控制 · 数学 2022-02-22 Gianluca Bianchin , Jorge I. Poveda , Emiliano Dall'Anese

Background: Catastrophic forgetting is the notorious vulnerability of neural networks to the changes in the data distribution during learning. This phenomenon has long been considered a major obstacle for using learning agents in realistic…

机器学习 · 统计学 2021-10-19 Chen Zeno , Itay Golan , Elad Hoffer , Daniel Soudry

In this paper, we study optimization problems where the cost function contains time-varying parameters that are unmeasurable and evolve according to linear, yet unknown, dynamics. We propose a solution that leverages control theoretic tools…

最优化与控制 · 数学 2025-03-20 Shivanshu Tripathi , Abed AlRahman Al Makdah , Fabio Pasqualetti

We present a Bayesian optimization (BO) framework for tuning model predictive controllers (MPC) of central heating, ventilation, and air conditioning (HVAC) plants. This approach treats the functional relationship between the closed-loop…

系统与控制 · 电气工程与系统科学 2021-04-13 Qiugang Lu , Ranjeet Kumar , Victor M. Zavala

We propose an algorithm based on online convex optimization for controlling discrete-time linear dynamical systems. The algorithm is data-driven, i.e., does not require a model of the system, and is able to handle a priori unknown and…

最优化与控制 · 数学 2022-11-17 Marko Nonhoff , Matthias A. Müller

This study investigates the application of Bayesian Optimization (BO) for the hyperparameter tuning of neural networks, specifically targeting the enhancement of Convolutional Neural Networks (CNN) for image classification tasks. Bayesian…

机器学习 · 计算机科学 2024-10-30 Gabriele Onorato

In repeated interaction problems with adaptive agents, our objective often requires anticipating and optimizing over the space of possible agent responses. We show that many problems of this form can be cast as instances of online…

机器学习 · 计算机科学 2024-06-28 William Brown , Christos Papadimitriou , Tim Roughgarden

Recent work on Bayesian optimization has shown its effectiveness in global optimization of difficult black-box objective functions. Many real-world optimization problems of interest also have constraints which are unknown a priori. In this…

机器学习 · 统计学 2014-03-25 Michael A. Gelbart , Jasper Snoek , Ryan P. Adams

Bayesian Optimization (BO) is an effective method for optimizing expensive-to-evaluate black-box functions with a wide range of applications for example in robotics, system design and parameter optimization. However, scaling BO to problems…

系统与控制 · 电气工程与系统科学 2020-01-22 Lukas P. Fröhlich , Edgar D. Klenske , Christian G. Daniel , Melanie N. Zeilinger

This paper considers online convex optimization with time-varying constraint functions. Specifically, we have a sequence of convex objective functions $\{f_t(x)\}_{t=0}^{\infty}$ and convex constraint functions…

最优化与控制 · 数学 2017-02-20 Michael J. Neely , Hao Yu

Online experiments in internet systems, also known as A/B tests, are used for a wide range of system tuning problems, such as optimizing recommender system ranking policies and learning adaptive streaming controllers. Decision-makers…

机器学习 · 计算机科学 2025-07-01 Qing Feng , Samuel Daulton , Benjamin Letham , Maximilian Balandat , Eytan Bakshy

This paper presents an automated, model-free, data-driven method for the safe tuning of PID cascade controller gains based on Bayesian optimization. The optimization objective is composed of data-driven performance metrics and modeled using…

系统与控制 · 电气工程与系统科学 2021-08-12 Christopher König , Mohammad Khosravi , Markus Maier , Roy S. Smith , Alisa Rupenyan , John Lygeros

The performance of deep (reinforcement) learning systems crucially depends on the choice of hyperparameters. Their tuning is notoriously expensive, typically requiring an iterative training process to run for numerous steps to convergence.…

机器学习 · 计算机科学 2021-01-19 Vu Nguyen , Sebastian Schulze , Michael A Osborne

Bayesian Optimisation (BO) is a family of methods for finding optimal parameters when the underlying function to be optimised is unknown. BO is used, for example, for hyperparameter tuning in machine learning and as an expert support tool…

Data-efficiency is crucial for autonomous robots to adapt to new tasks and environments. In this work we focus on robotics problems with a budget of only 10-20 trials. This is a very challenging setting even for data-efficient approaches…

机器人学 · 计算机科学 2019-07-11 Rika Antonova , Akshara Rai , Tianyu Li , Danica Kragic