中文
相关论文

相关论文: Cascading Bandits Robust to Adversarial Corruption…

200 篇论文

Contextual bandit learning is a reinforcement learning problem where the learner repeatedly receives a set of features (context), takes an action and receives a reward based on the action and context. We consider this problem under a…

机器学习 · 计算机科学 2012-03-05 Alekh Agarwal , Miroslav Dudík , Satyen Kale , John Langford , Robert E. Schapire

A popular approach to selling online advertising is by a waterfall, where a publisher makes sequential price offers to ad networks for an inventory, and chooses the winner in that order. The publisher picks the order and prices to maximize…

机器学习 · 计算机科学 2019-04-23 Branislav Kveton , Saied Mahdian , S. Muthukrishnan , Zheng Wen , Yikun Xian

In this paper, we consider the stochastic multi-armed bandits problem with adversarial corruptions, where the random rewards of the arms are partially modified by an adversary to fool the algorithm. We apply the policy gradient algorithm…

机器学习 · 计算机科学 2025-02-21 Jiayuan Liu , Siwei Wang , Zhixuan Fang

We introduce the novel approach towards fake text reviews detection in collaborative filtering recommender systems. The existing algorithms concentrate on detecting the fake reviews, generated by language models and ignore the texts,…

人工智能 · 计算机科学 2023-01-10 Yuliya Tukmacheva , Ivan Oseledets , Evgeny Frolov

In digital health and EdTech, recommendation systems face a significant challenge: users often choose impulsively, in ways that conflict with the platform's long-term payoffs. This misalignment makes it difficult to effectively learn to…

机器学习 · 计算机科学 2024-02-22 Arpit Agarwal , Rad Niazadeh , Prathamesh Patil

We develop a learning principle and an efficient algorithm for batch learning from logged bandit feedback. This learning setting is ubiquitous in online systems (e.g., ad placement, web search, recommendation), where an algorithm makes a…

机器学习 · 计算机科学 2015-05-22 Adith Swaminathan , Thorsten Joachims

We study the problems of distributed online and bandit convex optimization against an adaptive adversary. We aim to minimize the average regret on $M$ machines working in parallel over $T$ rounds with $R$ intermittent communications.…

机器学习 · 计算机科学 2023-11-30 Kumar Kshitij Patel , Lingxiao Wang , Aadirupa Saha , Nati Sebro

In the dynamic landscape of online businesses, recommender systems are pivotal in enhancing user experiences. While traditional approaches have relied on static supervised learning, the quest for adaptive, user-centric recommendations has…

信息检索 · 计算机科学 2023-12-22 Yikun Ban , Yunzhe Qi , Jingrui He

In machine learning, the notion of multi-armed bandits refers to a class of online learning problems, in which an agent is supposed to simultaneously explore and exploit a given set of choice alternatives in the course of a sequential…

机器学习 · 计算机科学 2021-07-13 Viktor Bengs , Robert Busa-Fekete , Adil El Mesaoudi-Paul , Eyke Hüllermeier

We extend the model of stochastic bandits with adversarial corruption (Lykouriset al., 2018) to the stochastic linear optimization problem (Dani et al., 2008). Our algorithm is agnostic to the amount of corruption chosen by the adaptive…

机器学习 · 计算机科学 2019-09-06 Yingkai Li , Edmund Y. Lou , Liren Shan

This paper examines whether widely used online learning algorithms in pricing can independently reach competitive outcomes or instead foster tacit collusion. This issue has drawn considerable attention from competition regulators as…

计算机科学与博弈论 · 计算机科学 2025-11-25 Martin Bichler , Julius Durmann , Matthias Oberlechner

We study adversarial attacks that manipulate the reward signals to control the actions chosen by a stochastic multi-armed bandit algorithm. We propose the first attack against two popular bandit algorithms: $\epsilon$-greedy and UCB,…

机器学习 · 计算机科学 2018-10-30 Kwang-Sung Jun , Lihong Li , Yuzhe Ma , Xiaojin Zhu

Increasingly, recommender systems are tasked with improving users' long-term satisfaction. In this context, we study a content exploration task, which we formalize as a bandit problem with delayed rewards. There is an apparent trade-off in…

机器学习 · 计算机科学 2025-01-15 Kelly W. Zhang , Thomas Baldwin-McDonald , Kamil Ciosek , Lucas Maystre , Daniel Russo

Recent works have shown that agents facing independent instances of a stochastic $K$-armed bandit can collaborate to decrease regret. However, these works assume that each agent always recommends their individual best-arm estimates to other…

机器学习 · 计算机科学 2022-03-02 Daniel Vial , Sanjay Shakkottai , R. Srikant

We develop a novel and generic algorithm for the adversarial multi-armed bandit problem (or more generally the combinatorial semi-bandit problem). When instantiated differently, our algorithm achieves various new data-dependent regret…

机器学习 · 计算机科学 2018-06-08 Chen-Yu Wei , Haipeng Luo

We investigate the regret-minimisation problem in a multi-armed bandit setting with arbitrary corruptions. Similar to the classical setup, the agent receives rewards generated independently from the distribution of the arm chosen at each…

机器学习 · 统计学 2023-09-29 Shubhada Agrawal , Timothée Mathieu , Debabrota Basu , Odalric-Ambrym Maillard

Recent works on Multi-Armed Bandits (MAB) and Combinatorial Multi-Armed Bandits (COM-MAB) show good results on a global accuracy metric. This can be achieved, in the case of recommender systems, with personalization. However, with a…

机器学习 · 计算机科学 2020-09-17 Alexandre Letard , Tassadit Amghar , Olivier Camp , Nicolas Gutowski

Contextual bandit algorithms have become popular for online recommendation systems such as Digg, Yahoo! Buzz, and news recommendation in general. \emph{Offline} evaluation of the effectiveness of new algorithms in these applications is…

机器学习 · 计算机科学 2015-03-13 Lihong Li , Wei Chu , John Langford , Xuanhui Wang

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by the clinical trials and recommendation problem, we assume that two arms are connected if and only if they are similar (i.e., their means are…

机器学习 · 计算机科学 2024-05-21 Han Qi , Guo Fei , Li Zhu

In today's business marketplace, many high-tech Internet enterprises constantly explore innovative ways to provide optimal online user experiences for gaining competitive advantages. The great needs of developing intelligent interactive…

信息检索 · 计算机科学 2021-07-02 Qing Wang