中文
相关论文

相关论文: Learning the Optimal Recommendation from Explorati…

200 篇论文

Most modern systems strive to learn from interactions with users, and many engage in exploration: making potentially suboptimal choices for the sake of acquiring new information. We initiate a study of the interplay between exploration and…

计算机科学与博弈论 · 计算机科学 2017-11-21 Yishay Mansour , Aleksandrs Slivkins , Zhiwei Steven Wu

We study a sequential resource allocation problem between a fixed number of arms. On each iteration the algorithm distributes a resource among the arms in order to maximize the expected success rate. Allocating more of the resource to a…

机器学习 · 计算机科学 2018-03-29 Yuval Dagan , Koby Crammer

We study sequential decision-making with known rewards and unknown constraints, motivated by situations where the constraints represent expensive-to-evaluate human preferences, such as safe and comfortable driving behavior. We formalize the…

机器学习 · 计算机科学 2022-06-13 David Lindner , Sebastian Tschiatschek , Katja Hofmann , Andreas Krause

We study best arm identification in a variant of the multi-armed bandit problem where the learner has limited precision in arm selection. The learner can only sample arms via certain exploration bundles, which we refer to as boxes. In…

机器学习 · 计算机科学 2023-05-11 Kota Srinivas Reddy , P. N. Karthik , Nikhil Karamchandani , Jayakrishnan Nair

Modern recommendation systems ought to benefit by probing for and learning from delayed feedback. Research has tended to focus on learning from a user's response to a single recommendation. Such work, which leverages methods of supervised…

信息检索 · 计算机科学 2023-08-01 Zheqing Zhu , Benjamin Van Roy

In this paper, we investigate the impact of diverse user preference on learning under the stochastic multi-armed bandit (MAB) framework. We aim to show that when the user preferences are sufficiently diverse and each arm can be optimal for…

机器学习 · 计算机科学 2022-11-11 Chao Gan , Jing Yang , Ruida Zhou , Cong Shen

We study the repeated principal-agent bandit game, where the principal indirectly interacts with the unknown environment by proposing incentives for the agent to play arms. Most existing work assumes the agent has full knowledge of the…

机器学习 · 计算机科学 2025-06-03 Junyan Liu , Lillian J. Ratliff

We consider the best-arm identification problem in multi-armed bandits, which focuses purely on exploration. A player is given a fixed budget to explore a finite set of arms, and the rewards of each arm are drawn independently from a fixed,…

机器学习 · 统计学 2017-08-02 Shahin Shahrampour , Mohammad Noshad , Vahid Tarokh

Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the…

机器学习 · 计算机科学 2019-09-02 Chao Tao , Qin Zhang , Yuan Zhou

Motivated by models of human decision making proposed to explain commonly observed deviations from conventional expected value preferences, we formulate two stochastic multi-armed bandit problems with distorted probabilities on the reward…

机器学习 · 计算机科学 2023-11-01 Ravi Kumar Kolla , Prashanth L. A. , Aditya Gopalan , Krishna Jagannathan , Michael Fu , Steve Marcus

We propose the first fully-adaptive algorithm for pure exploration in linear bandits---the task to find the arm with the largest expected reward, which depends on an unknown parameter linearly. While existing methods partially or entirely…

机器学习 · 统计学 2017-10-17 Liyuan Xu , Junya Honda , Masashi Sugiyama

We consider regret minimization in a general collaborative multi-agent multi-armed bandit model, in which each agent faces a finite set of arms and may communicate with other agents through a central controller. The optimal arm for each…

机器学习 · 计算机科学 2023-12-18 Amitis Shidani , Sattar Vakili

This paper proposes a new approach to training recommender systems called deviation-based learning. The recommender and rational users have different knowledge. The recommender learns user knowledge by observing what action users take upon…

理论经济学 · 经济学 2022-08-22 Junpei Komiyama , Shunya Noda

We study the non-stationary stochastic multi-armed bandit problem, where the reward statistics of each arm may change several times during the course of learning. The performance of a learning algorithm is evaluated in terms of their…

机器学习 · 计算机科学 2022-03-09 Yasin Abbasi-Yadkori , Andras Gyorgy , Nevena Lazic

We consider the bandit problem of selecting $K$ out of $N$ arms at each time step. The reward can be a non-linear function of the rewards of the selected individual arms. The direct use of a multi-armed bandit algorithm requires choosing…

机器学习 · 计算机科学 2026-02-16 Mridul Agarwal , Vaneet Aggarwal , Christopher J. Quinn , Abhishek Umrawal

In the Best-$K$ identification problem (Best-$K$-Arm), we are given $N$ stochastic bandit arms with unknown reward distributions. Our goal is to identify the $K$ arms with the largest means with high confidence, by drawing samples from the…

机器学习 · 计算机科学 2017-05-22 Haotian Jiang , Jian Li , Mingda Qiao

We study the problem of identifying the best arm in a stochastic multi-armed bandit game. Given a set of $n$ arms indexed from $1$ to $n$, each arm $i$ is associated with an unknown reward distribution supported on $[0,1]$ with mean…

机器学习 · 计算机科学 2023-05-30 Pinyan Lu , Chao Tao , Xiaojin Zhang

In today's business marketplace, many high-tech Internet enterprises constantly explore innovative ways to provide optimal online user experiences for gaining competitive advantages. The great needs of developing intelligent interactive…

信息检索 · 计算机科学 2021-07-02 Qing Wang

Recommender system has been deployed in a large amount of real-world applications, profoundly influencing people's daily life and production.Traditional recommender models mostly collect as comprehensive as possible user behaviors for…

信息检索 · 计算机科学 2022-11-03 Lei Wang , Xu Chen , Quanyu Dai , Zhenhua Dong

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

机器学习 · 计算机科学 2018-12-04 Jun Geng , Lifeng Lai