English
Related papers

Related papers: Multi-armed Bandit for Stochastic Shortest Path in…

200 papers

In this paper, we generalize the concept of heavy-tailed multi-armed bandits to adversarial environments, and develop robust best-of-both-worlds algorithms for heavy-tailed multi-armed bandits (MAB), where losses have $\alpha$-th…

Machine Learning · Computer Science 2022-06-14 Jiatai Huang , Yan Dai , Longbo Huang

Multi-robot navigation and path planning in continuous state and action spaces with uncertain environments remains an open challenge. Deep Reinforcement Learning (RL) is one of the most popular paradigms for solving this task, but its…

Robotics · Computer Science 2025-08-21 Jahid Chowdhury Choton , John Woods , William Hsu

Multi-agent pathfinding (MAPF) is the problem of finding a set of conflict-free paths for a set of agents. Typically, the agents' moves are limited to a pre-defined graph of possible locations and allowed transitions between them, e.g. a…

Artificial Intelligence · Computer Science 2024-09-02 Konstantin Yakovlev , Anton Andreychuk , Roni Stern

Motivated by economic applications such as recommender systems, we study the behavior of stochastic bandits algorithms under \emph{strategic behavior} conducted by rational actors, i.e., the arms. Each arm is a \emph{self-interested}…

Machine Learning · Computer Science 2020-11-16 Zhe Feng , David C. Parkes , Haifeng Xu

Multi-armed Bandit motivates methods with provable upper bounds on regret and also the counterpart lower bounds have been extensively studied in this context. Recently, Multi-agent Multi-armed Bandit has gained significant traction in…

Machine Learning · Computer Science 2023-08-17 Mengfan Xu , Diego Klabjan

Recent advances in 3D fabrication have allowed handling the memory bottlenecks for modern data-intensive applications by bringing the computation closer to the memory, enabling Near Memory Processing (NMP). Memory Centric Networks (MCN) are…

Hardware Architecture · Computer Science 2023-12-14 Shubhang Pandey , T G Venkatesh

Efficiently trading off exploration and exploitation is one of the key challenges in online Reinforcement Learning (RL). Most works achieve this by carefully estimating the model uncertainty and following the so-called optimistic model.…

Machine Learning · Computer Science 2024-09-16 Asaf Cassel , Orin Levy , Yishay Mansour

Upper Confidence Bound (UCB) method is arguably the most celebrated one used in online decision making with partial information feedback. Existing techniques for constructing confidence bounds are typically built upon various concentration…

Machine Learning · Statistics 2019-11-01 Botao Hao , Yasin Abbasi-Yadkori , Zheng Wen , Guang Cheng

This work studies online episodic tabular Markov decision processes (MDPs) with known transitions and develops best-of-both-worlds algorithms that achieve refined data-dependent regret bounds in the adversarial regime and variance-dependent…

Machine Learning · Computer Science 2026-02-03 Mingyi Li , Taira Tsuchiya , Kenji Yamanishi

We address the problem of coordination and control of Connected and Automated Vehicles (CAVs) in the presence of imperfect observations in mixed traffic environment. A commonly used approach is learning-based decision-making, such as…

Robotics · Computer Science 2024-09-25 Zhili Zhang , H M Sabbir Ahmad , Ehsan Sabouni , Yanchao Sun , Furong Huang , Wenchao Li , Fei Miao

A survey is performed of various Multi-Armed Bandit (MAB) strategies in order to examine their performance in circumstances exhibiting non-stationary stochastic reward functions in conjunction with delayed feedback. We run several MAB…

Machine Learning · Computer Science 2019-07-31 Larkin Liu , Richard Downe , Joshua Reid

We consider a resource-aware variant of the classical multi-armed bandit problem: In each round, the learner selects an arm and determines a resource limit. It then observes a corresponding (random) reward, provided the (random) amount of…

Machine Learning · Computer Science 2022-10-18 Viktor Bengs , Eyke Hüllermeier

We propose a novel combinatorial stochastic-greedy bandit (SGB) algorithm for combinatorial multi-armed bandit problems when no extra information other than the joint reward of the selected set of $n$ arms at each time step $t\in [T]$ is…

Machine Learning · Computer Science 2023-12-14 Fares Fourati , Christopher John Quinn , Mohamed-Slim Alouini , Vaneet Aggarwal

Multi-armed bandit (MAB) is a classic model for understanding the exploration-exploitation trade-off. The traditional MAB model for recommendation systems assumes the user stays in the system for the entire learning horizon. In new online…

Machine Learning · Computer Science 2022-05-30 Zixian Yang , Xin Liu , Lei Ying

The classic multi-armed bandit (MAB) problem tackles the challenge of accruing maximum reward while making decisions under uncertainty. However, in applications, often the goal is to minimize cost subject to a constraint on the minimum…

Machine Learning · Computer Science 2026-05-11 Ishank Juneja , Carlee Joe-Wong , Osman Yağan

Multi-arm bandit (MAB) algorithms have been used to learn optimal beams for millimeter wave communication systems. Here, the complexity of learning the optimal beam linearly scales with the number of beams, leading to high latency when…

Signal Processing · Electrical Eng. & Systems 2023-06-30 Akanksha Sneh , Sumit Darak , Shobha Sundar Ram , Manjesh Hanawal

Motivated by privacy concerns in sequential decision-making on sensitive data, we address the challenge of nonparametric contextual multi-armed bandits (MAB) under local differential privacy (LDP). We develop a uniform-confidence-bound-type…

Machine Learning · Statistics 2025-03-26 Yuheng Ma , Feiyu Jiang , Zifeng Zhao , Hanfang Yang , Yi Yu

We study distributed cooperative decision-making under the explore-exploit tradeoff in the multiarmed bandit (MAB) problem. We extend the state-of-the-art frequentist and Bayesian algorithms for single-agent MAB problems to cooperative…

Systems and Control · Computer Science 2019-09-18 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

We present a provably optimal differentially private algorithm for the stochastic multi-arm bandit problem, as opposed to the private analogue of the UCB-algorithm [Mishra and Thakurta, 2015; Tossou and Dimitrakakis, 2016] which doesn't…

Machine Learning · Statistics 2019-05-24 Touqir Sajed , Or Sheffet

Multi-armed bandit algorithms provide solutions for sequential decision-making where learning takes place by interacting with the environment. In this work, we model a distributed optimization problem as a multi-agent kernelized multi-armed…

Machine Learning · Computer Science 2023-12-11 Ayush Rai , Shaoshuai Mou
‹ Prev 1 8 9 10 Next ›