English
Related papers

Related papers: Real-Time Black-Box Optimization for Dynamic Discr…

200 papers

Interactive Machine Learning (IML) seeks to integrate human expertise into machine learning processes. However, most existing algorithms cannot be applied to Realworld Scenarios because their state spaces and/or action spaces are limited to…

Robotics · Computer Science 2024-01-24 Nikolaus Feith , Elmar Rueckert

This paper introduces a new approach that leverages Multi-agent Bayesian Optimization (MABO) to design Distributed Model Predictive Control (DMPC) schemes for multi-agent systems. The primary objective is to learn optimal DMPC schemes even…

Systems and Control · Electrical Eng. & Systems 2025-05-21 Hossein Nejatbakhsh Esfahani , Kai Liu , Javad Mohammadpour Velni

Conventional Multi-Armed Bandit (MAB) algorithms are designed for stationary environments, where the reward distributions associated with the arms do not change with time. In many applications, however, the environment is more accurately…

Artificial Intelligence · Computer Science 2025-11-05 Yu-Han Huang , Argyrios Gerogiannis , Subhonmesh Bose , Venugopal V. Veeravalli

E-commerce sites strive to provide users the most timely relevant information in order to reduce shopping frictions and increase customer satisfaction. Multi armed bandit models (MAB) as a type of adaptive optimization algorithms provide…

Information Retrieval · Computer Science 2021-08-23 Ding Xiang , Becky West , Jiaqi Wang , Xiquan Cui , Jinzhou Huang

When gradient-based methods are impractical, black-box optimization (BBO) provides a valuable alternative. However, BBO often struggles with high-dimensional problems and limited trial budgets. In this work, we propose a novel approach…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Riccardo Busetto , Manas Mejari , Marco Forgione , Alberto Bemporad , Dario Piga

Some real problems require the evaluation of expensive and noisy objective functions. Moreover, the analytical expression of these objective functions may be unknown. These functions are known as black-boxes, for example, estimating the…

Machine Learning · Statistics 2021-07-12 Lucia Asencio Martín , Eduardo C. Garrido-Merchán

The multi-armed bandit (MAB) problem models a decision-maker that optimizes its actions based on current and acquired new knowledge to maximize its reward. This type of online decision is prominent in many procedures of Brain-Computer…

Artificial Intelligence · Computer Science 2022-11-10 Frida Heskebeck , Carolina Bergeling , Bo Bernhardsson

Bayesian optimization (BO) is one of the most powerful strategies to solve computationally expensive-to-evaluate blackbox optimization problems. However, BO methods are conventionally used for optimization problems of small dimension…

Optimization and Control · Mathematics 2025-02-10 Rémy Priem , Youssef Diouane , Nathalie Bartoli , Sylvain Dubreuil , Paul Saves

The multi-armed bandit (MAB) problem is an active learning framework that aims to select the best among a set of actions by sequentially observing rewards. Recently, it has become popular for a number of applications over wireless networks,…

Machine Learning · Computer Science 2021-11-12 Osama A. Hanna , Lin F. Yang , Christina Fragouli

Efficient optimisation of black-box problems that comprise both continuous and categorical inputs is important, yet poses significant challenges. We propose a new approach, Continuous and Categorical Bayesian Optimisation (CoCaBO), which…

Machine Learning · Statistics 2020-08-11 Binxin Ru , Ahsan S. Alvi , Vu Nguyen , Michael A. Osborne , Stephen J Roberts

We analytically derive a class of optimal solutions to a linear program (LP) for automated mechanism design that satisfies efficiency, incentive compatibility, strong budget balance (SBB), and individual rationality (IR), where SBB and IR…

Computer Science and Game Theory · Computer Science 2025-05-20 Takayuki Osogami , Hirota Kinoshita , Segev Wasserkrug

Black-box optimization is a powerful approach for discovering global optima in noisy and expensive black-box functions, a problem widely encountered in real-world scenarios. Recently, there has been a growing interest in leveraging domain…

Machine Learning · Computer Science 2024-02-06 Dat Phan-Trong , Hung The Tran , Alistair Shilton , Sunil Gupta

Recent years have witnessed the emergence of mobile edge computing (MEC), on the premise of a cost-effective enhancement in the computational ability of hardware-constrained wireless devices (WDs) comprising the Internet of Things (IoT). In…

Networking and Internet Architecture · Computer Science 2024-10-28 Jia Yan , Qin Lu , Georgios B. Giannakis

To perform dynamic cable manipulation to realize the configuration specified by a target image, we formulate dynamic cable manipulation as a stochastic forward model. Then, we propose a method to handle uncertainty by maximizing the…

Robotics · Computer Science 2023-01-30 Kuniyuki Takahashi , Tadahiro Taniguchi

We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external…

Machine Learning · Statistics 2024-06-27 Osama Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

In recent years, the integration of communication and control systems has gained significant traction in various domains, ranging from autonomous vehicles to industrial automation and beyond. Multi-armed bandit (MAB) algorithms have proven…

Systems and Control · Electrical Eng. & Systems 2024-05-16 Hiba Dakdouk , Mohamed Sana , Mattia Merluzzi

Existing studies in black-box optimization for machine learning suffer from low generalizability, caused by a typically selective choice of problem instances used for training and testing different optimization algorithms. Among other…

Ising machines are next-generation computers expected to efficiently sample near-optimal solutions of combinatorial optimization problems. Combinatorial optimization problems are modeled as quadratic unconstrained binary optimization (QUBO)…

Optimization and Control · Mathematics 2024-06-21 Kentaro Ohno , Nozomu Togawa

The adoption of dynamic, self-learning solutions for real-time wireless network optimization has recently gained significant attention due to the limited adaptability of existing protocols. This paper investigates multi-armed bandit (MAB)…

Networking and Internet Architecture · Computer Science 2025-12-01 Miguel Casasnovas , Francesc Wilhelmi , Richard Combes , Maksymilian Wojnar , Katarzyna Kosek-Szott , Szymon Szott , Anders Jonsson , Luis Esteve , Boris Bellalta

Due to the very narrow beam used in millimeter wave communication (mmWave), beam alignment (BA) is a critical issue. In this work, we investigate the issue of mmWave BA and present a novel beam alignment scheme on the basis of a machine…

Signal Processing · Electrical Eng. & Systems 2022-07-29 Songjie Yang , Baojuan Liu , Zhiqin Hong , Zhongpei Zhang