中文
相关论文

相关论文: (Locally) Differentially Private Combinatorial Sem…

200 篇论文

Contextual bandit with linear reward functions is among one of the most extensively studied models in bandit and online learning research. Recently, there has been increasing interest in designing \emph{locally private} linear contextual…

机器学习 · 统计学 2024-04-16 Jiachun Li , David Simchi-Levi , Yining Wang

We investigate the problem of stochastic, combinatorial multi-armed bandits where the learner only has access to bandit feedback and the reward function can be non-linear. We provide a general framework for adapting discrete offline…

机器学习 · 计算机科学 2023-10-13 Guanyu Nie , Yididiya Y Nadew , Yanhui Zhu , Vaneet Aggarwal , Christopher John Quinn

We investigate stochastic combinatorial multi-armed bandit with semi-bandit feedback (CMAB). In CMAB, the question of the existence of an efficient policy with an optimal asymptotic regret (up to a factor poly-logarithmic with the action…

机器学习 · 统计学 2021-01-05 Pierre Perrault , Etienne Boursier , Vianney Perchet , Michal Valko

We present the first high-probability optimal regret bound for a policy optimization technique applied to the problem of stochastic contextual multi-armed bandit (CMAB) with general offline function approximation. Our algorithm is both…

机器学习 · 计算机科学 2026-02-17 Orin Levy , Yishay Mansour

We study the stochastic Multiplayer Multi-Armed Bandit (MMAB) problem, where multiple players select arms to maximize their cumulative rewards. Collisions occur when two or more players select the same arm, resulting in no reward, and are…

机器学习 · 计算机科学 2025-10-09 Daoyuan Zhou , Xuchuang Wang , Lin Yang , Yang Gao

We consider a contextual combinatorial bandit problem where in each round a learning agent selects a subset of arms and receives feedback on the selected arms according to their scores. The score of an arm is an unknown function of the…

机器学习 · 统计学 2023-06-02 Taehyun Hwang , Kyuwook Chai , Min-hwan Oh

In many modern applications, a system must dynamically choose between several adaptive learning algorithms that are trained online. Examples include model selection in streaming environments, switching between trading strategies in finance,…

机器学习 · 计算机科学 2026-01-19 Ilgam Latypov , Alexandra Suvorikova , Alexey Kroshnin , Alexander Gasnikov , Yuriy Dorn

Dueling bandits is a prominent framework for decision-making involving preferential feedback, a valuable feature that fits various applications involving human interaction, such as ranking, information retrieval, and recommendation systems.…

机器学习 · 计算机科学 2024-10-16 Qiwei Di , Tao Jin , Yue Wu , Heyang Zhao , Farzad Farnoud , Quanquan Gu

Multi-armed bandit (MAB) is a class of online learning problems where a learning agent aims to maximize its expected cumulative reward while repeatedly selecting to pull arms with unknown reward distributions. We consider a scenario where…

机器学习 · 统计学 2019-01-25 Yang Cao , Zheng Wen , Branislav Kveton , Yao Xie

This paper investigates the problem of combinatorial multiarmed bandits with stochastic submodular (in expectation) rewards and full-bandit delayed feedback, where the delayed feedback is assumed to be composite and anonymous. In other…

机器学习 · 计算机科学 2025-01-23 Mohammad Pedramfar , Vaneet Aggarwal

This paper considers causal bandits (CBs) for the sequential design of interventions in a causal system. The objective is to optimize a reward function via minimizing a measure of cumulative regret with respect to the best sequence of…

机器学习 · 统计学 2024-03-04 Zirui Yan , Dennis Wei , Dmitriy Katz-Rogozhnikov , Prasanna Sattigeri , Ali Tajer

In many real-world sequential decision-making problems, an action does not immediately reflect on the feedback and spreads its effects over a long time frame. For instance, in online advertising, investing in a platform produces an…

机器学习 · 计算机科学 2023-05-31 Marco Mussi , Alberto Maria Metelli , Marcello Restelli

Contextual multi-armed bandit (MAB) is an important sequential decision-making problem in recommendation systems. A line of works, called the clustering of bandits (CLUB), utilize the collaborative effect over users and dramatically improve…

机器学习 · 计算机科学 2022-09-01 Xutong Liu , Haoru Zhao , Tong Yu , Shuai Li , John C. S. Lui

Reinforcement learning algorithms are widely used in domains where it is desirable to provide a personalized service. In these domains it is common that user data contains sensitive information that needs to be protected from third parties.…

机器学习 · 计算机科学 2021-10-28 Evrard Garcelon , Vianney Perchet , Ciara Pike-Burke , Matteo Pirotta

We consider the adversarial combinatorial multi-armed bandit (CMAB) problem, whose decision set can be exponentially large with respect to the number of given arms. To avoid dealing with such large decision sets directly, we propose an…

数据结构与算法 · 计算机科学 2017-07-27 Shinsaku Sakaue , Masakazu Ishihata , Shin-ichi Minato

Federated multi-armed bandits (FMAB) is a new bandit paradigm that parallels the federated learning (FL) framework in supervised learning. It is inspired by practical applications in cognitive radio and recommender systems, and enjoys…

机器学习 · 计算机科学 2021-03-04 Chengshuai Shi , Cong Shen

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

Upper Confidence Bound (UCB) algorithms are a widely-used class of sequential algorithms for the $K$-armed bandit problem. Despite extensive research over the past decades aimed at understanding their asymptotic and (near) minimax…

统计理论 · 数学 2024-12-10 Qiyang Han , Koulik Khamaru , Cun-Hui Zhang

Multi-armed bandit algorithms provide solutions for sequential decision-making where learning takes place by interacting with the environment. In this work, we model a distributed optimization problem as a multi-agent kernelized multi-armed…

机器学习 · 计算机科学 2023-12-11 Ayush Rai , Shaoshuai Mou

We study regret minimization in finite horizon tabular Markov decision processes (MDPs) under the constraints of differential privacy (DP). This is motivated by the widespread applications of reinforcement learning (RL) in real-world…

机器学习 · 计算机科学 2021-12-21 Sayak Ray Chowdhury , Xingyu Zhou