English
Related papers

Related papers: Integrating Multi-Armed Bandit, Active Learning, a…

200 papers

The Alternating Direction Method of Multipliers (ADMM) has gained a lot of attention for solving large-scale and objective-separable constrained optimization. However, the two-block variable structure of the ADMM still limits the practical…

Optimization and Control · Mathematics 2020-03-24 Kresimir Mihic , Mingxi Zhu , Yinyu Ye

Handcrafted optimizers become prohibitively inefficient for complex black-box optimization (BBO) tasks. MetaBBO addresses this challenge by meta-learning to automatically configure optimizers for low-level BBO tasks, thereby eliminating…

Neural and Evolutionary Computing · Computer Science 2026-02-10 Chao Wang , Licheng Jiao , Lingling Li , Jiaxuan Zhao , Guanchun Wang , Fang Liu , Shuyuan Yang

We consider the query recommendation problem in closed loop interactive learning settings like online information gathering and exploratory analytics. The problem can be naturally modelled using the Multi-Armed Bandits (MAB) framework with…

State of the art online learning procedures focus either on selecting the best alternative ("best arm identification") or on minimizing the cost (the "regret"). We merge these two objectives by providing the theoretical analysis of cost…

Machine Learning · Computer Science 2019-02-27 Rémy Degenne , Thomas Nedelec , Clément Calauzènes , Vianney Perchet

Existing frameworks for evaluating and comparing generative models consider an offline setting, where the evaluator has access to large batches of data produced by the models. However, in practical scenarios, the goal is often to identify…

Machine Learning · Computer Science 2025-03-12 Xiaoyan Hu , Ho-fung Leung , Farzan Farnia

Modern deep learning methods are very sensitive to many hyperparameters, and, due to the long training times of state-of-the-art models, vanilla Bayesian hyperparameter optimization is typically computationally infeasible. On the other…

Machine Learning · Computer Science 2018-07-06 Stefan Falkner , Aaron Klein , Frank Hutter

Modern recommendation systems frequently employ online learning to dynamically update their models with freshly collected data. The most commonly used optimizer for updating neural networks in these contexts is the Adam optimizer, which…

Machine Learning · Computer Science 2025-06-05 Shaowen Wang , Anan Liu , Jian Xiao , Huan Liu , Yuekui Yang , Cong Xu , Qianqian Pu , Suncong Zheng , Wei Zhang , Di Wang , Jie Jiang , Jian Li

When gradient-based methods are impractical, black-box optimization (BBO) provides a valuable alternative. However, BBO often struggles with high-dimensional problems and limited trial budgets. In this work, we propose a novel approach…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Riccardo Busetto , Manas Mejari , Marco Forgione , Alberto Bemporad , Dario Piga

Multi-label image classification demands adaptive training strategies to navigate complex, evolving visual-semantic landscapes, yet conventional methods rely on static configurations that falter in dynamic settings. We propose MAT-Agent, a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Jusheng Zhang , Kaitong Cai , Yijia Fan , Ningyuan Liu , Keze Wang

We propose a black-box reduction that turns a certain reinforcement learning algorithm with optimal regret in a (near-)stationary environment into another algorithm with optimal dynamic regret in a non-stationary environment, importantly…

Machine Learning · Computer Science 2021-09-07 Chen-Yu Wei , Haipeng Luo

Quite some real-world problems can be formulated as decision-making problems wherein one must repeatedly make an appropriate choice from a set of alternatives. Multiple expert judgements, whether human or artificial, can help in taking…

Artificial Intelligence · Computer Science 2022-08-30 Axel Abels , Tom Lenaerts , Vito Trianni , Ann Nowé

Recent research indicates that large language models (LLMs) are susceptible to jailbreaking attacks that can generate harmful content. This paper introduces a novel token-level attack method, Adaptive Dense-to-Sparse Constrained…

Machine Learning · Computer Science 2025-02-13 Kai Hu , Weichen Yu , Yining Li , Kai Chen , Tianjun Yao , Xiang Li , Wenhe Liu , Lijun Yu , Zhiqiang Shen , Matt Fredrikson

In modern ML Ops environments, model deployment is a critical process that traditionally relies on static heuristics such as validation error comparisons and A/B testing. However, these methods require human intervention to adapt to…

Machine Learning · Computer Science 2025-03-31 S. Aaron McClendon , Vishaal Venkatesh , Juan Morinelli

Internet of Things (IoT) systems increasingly operate in environments where devices must respond in real time while managing fluctuating resource constraints, including energy and bandwidth. Yet, current approaches often fall short in…

Machine Learning · Computer Science 2026-03-26 Shubham Vaishnav , Praveen Kumar Donta , Sindri Magnússon

In the evolution of 6th Generation (6G) technology, the emergence of cell-free networking presents a paradigm shift, revolutionizing user experiences within densely deployed networks where distributed access points collaborate. However, the…

Signal Processing · Electrical Eng. & Systems 2024-08-15 Dieter Verbruggen , Hazem Sallouha , Sofie Pollin

This paper studies the problem of distributed multi-agent Bayesian optimization with both coupled black-box constraints and known affine constraints. A primal-dual distributed algorithm is proposed that achieves similar regret/violation…

Machine Learning · Computer Science 2023-10-03 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

In this paper, we design algorithms to protect swarm-robotics applications against sensor denial-of-service (DoS) attacks on robots. We focus on applications requiring the robots to jointly select actions, e.g., which trajectory to follow,…

Robotics · Computer Science 2022-03-21 Lifeng Zhou , Vasileios Tzoumas , George J. Pappas , Pratap Tokekar

We study the problem of online clustering of data sequences in the multi-armed bandit (MAB) framework under the fixed-confidence setting. There are $M$ arms, each providing i.i.d. samples from a parametric distribution whose parameters are…

Machine Learning · Computer Science 2026-03-23 G Dhinesh Chandran , Srinivas Reddy Kota , Srikrishna Bhashyam

We study the Improving Multi-Armed Bandit (IMAB) problem, where the reward obtained from an arm increases with the number of pulls it receives. This model provides an elegant abstraction for many real-world problems in domains such as…

Machine Learning · Computer Science 2022-08-22 Vishakha Patil , Vineet Nair , Ganesh Ghalme , Arindam Khan

Automating physical database design has remained a long-term interest in database research due to substantial performance gains afforded by optimised structures. Despite significant progress, a majority of today's commercial solutions are…

Databases · Computer Science 2020-10-21 R. Malinga Perera , Bastian Oetomo , Benjamin I. P. Rubinstein , Renata Borovica-Gajic