English
Related papers

Related papers: Improving Portfolio Optimization Results with Band…

200 papers

We consider the non-stationary multi-armed bandit (MAB) framework and propose a Kolmogorov-Smirnov (KS) test based Thompson Sampling (TS) algorithm named TS-KS, that actively detects change points and resets the TS parameters once a change…

Machine Learning · Statistics 2021-10-22 Gourab Ghatak , Hardhik Mohanty , Aniq Ur Rahman

In mixed-autonomy traffic networks, autonomous vehicles (AVs) are required to make sequential routing decisions under uncertainty caused by dynamic and heterogeneous interactions with human-driven vehicles (HDVs). Early-stage greedy…

Optimization and Control · Mathematics 2025-05-12 Yu Bai , Yiming Li , Xi Xiong

Reviewing the previous work of diversity Rein-forcement Learning,diversity is often obtained via an augmented loss function,which requires a balance between reward and diversity.Generally,diversity optimization algorithms use Multi-armed…

Machine Learning · Computer Science 2024-03-19 Jingcheng Jiang , Haiyin Piao , Yu Fu , Yihang Hao , Chuanlu Jiang , Ziqi Wei , Xin Yang

The Multi-Armed Bandit (MAB) problem is challenging in non-stationary environments where reward distributions evolve dynamically. We introduce RAVEN-UCB, a novel algorithm that combines theoretical rigor with practical efficiency via…

Machine Learning · Computer Science 2025-06-04 Junyi Fang , Yuxun Chen , Yuxin Chen , Chen Zhang

This paper proposes a new algorithm, referred to as GMAB, that combines concepts from the reinforcement learning domain of multi-armed bandits and random search strategies from the domain of genetic algorithms to solve discrete stochastic…

Neural and Evolutionary Computing · Computer Science 2023-02-16 Deniz Preil , Michael Krapp

This paper considers the multi-armed bandit (MAB) problem and provides a new best-of-both-worlds (BOBW) algorithm that works nearly optimally in both stochastic and adversarial settings. In stochastic settings, some existing BOBW algorithms…

Machine Learning · Computer Science 2022-06-15 Shinji Ito , Taira Tsuchiya , Junya Honda

Prompting has emerged as the dominant paradigm for adapting large, pre-trained transformer-based models to downstream tasks. The Prompting Decision Transformer (PDT) enables large-scale, multi-task offline Reinforcement Learning (RL)…

Machine Learning · Computer Science 2025-07-21 Finn Rietz , Oleg Smirnov , Sara Karimi , Lele Cao

We study a decentralized cooperative multi-agent multi-armed bandit problem with $K$ arms and $N$ agents connected over a network. In our model, each arm's reward distribution is same for all agents, and rewards are drawn independently…

Machine Learning · Statistics 2020-10-29 Anusha Lalitha , Andrea Goldsmith

We study the multi-player stochastic multiarmed bandit (MAB) problem in an abruptly changing environment. We consider a collision model in which a player receives reward at an arm if it is the only player to select the arm. We design two…

Machine Learning · Statistics 2018-12-14 Lai Wei , Vaibhav Srivastava

Multi-armed bandit (MAB) is a class of online learning problems where a learning agent aims to maximize its expected cumulative reward while repeatedly selecting to pull arms with unknown reward distributions. We consider a scenario where…

Machine Learning · Statistics 2019-01-25 Yang Cao , Zheng Wen , Branislav Kveton , Yao Xie

In linear contextual bandits, the objective is to select actions that maximize cumulative rewards, modeled as a linear function with unknown parameters. Although Thompson Sampling performs well empirically, it does not achieve optimal…

Machine Learning · Statistics 2025-06-18 Wonyoung Kim

In this report, we survey Bayesian Optimization methods focussed on the Multi-Armed Bandit Problem. We take the help of the paper "Portfolio Allocation for Bayesian Optimization". We report a small literature survey on the acquisition…

Machine Learning · Computer Science 2020-12-16 Abhilash Nandy , Chandan Kumar , Deepak Mewada , Soumya Sharma

Sampling from the equilibrium distribution has always been a major problem in molecular simulations due to the very high dimensionality of conformational space. Over several decades, many approaches have been used to overcome the problem.…

Computational Physics · Physics 2020-03-02 Adrià Pérez , Pablo Herrera-Nieto , Stefan Doerr , Gianni De Fabritiis

We introduce algorithms that achieve state-of-the-art \emph{dynamic regret} bounds for non-stationary linear stochastic bandit setting. It captures natural applications such as dynamic pricing and ads allocation in a changing environment.…

Machine Learning · Computer Science 2021-07-20 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

Database activity monitoring (DAM) systems are commonly used by organizations to protect the organizational data, knowledge and intellectual properties. In order to protect organizations database DAM systems have two main roles, monitoring…

Machine Learning · Computer Science 2019-10-25 Hagit Grushka-Cohen , Ofer Biller , Oded Sofer , Lior Rokach , Bracha Shapira

With the increasing popularity of online learning, intelligent tutoring systems are regaining increased attention. In this paper, we introduce adaptive algorithms for personalized assignment of learning tasks to student so that to improve…

Artificial Intelligence · Computer Science 2016-06-24 Per-Arne Andersen , Christian Kråkevik , Morten Goodwin , Anis Yazidi

The multi-agent linear bandit setting is a well-known setting for which designing efficient collaboration between agents remains challenging. This paper studies the impact of data sharing among agents on regret minimization. Unlike most…

Machine Learning · Computer Science 2025-05-28 Hamza Cherkaoui , Merwan Barlier , Igor Colin

As two popular schools of machine learning, online learning and evolutionary computations have become two important driving forces behind real-world decision making engines for applications in biomedicine, economics, and engineering fields.…

Neural and Evolutionary Computing · Computer Science 2022-05-24 Baihan Lin

Bandit optimization usually refers to the class of online optimization problems with limited feedback, namely, a decision maker uses only the objective value at the current point to make a new decision and does not have access to the…

Machine Learning · Computer Science 2026-02-18 Yuriy Dorn , Aleksandr Katrutsa , Ilgam Latypov , Anastasiia Soboleva

Large language models (LLMs) have been adopted to solve sequential decision-making tasks such as multi-armed bandits (MAB), in which an LLM is directly instructed to select the arms to pull in every iteration. However, this paradigm of…

Machine Learning · Computer Science 2025-02-04 Jiahang Sun , Zhiyong Wang , Runhan Yang , Chenjun Xiao , John C. S. Lui , Zhongxiang Dai