中文
相关论文

相关论文: Target Tracking for Contextual Bandits: Applicatio…

200 篇论文

Bandit algorithms sequentially accumulate data using adaptive sampling policies, offering flexibility for real-world applications. However, excessive sampling can be costly, motivating the devolopment of early stopping methods and reliable…

统计理论 · 数学 2025-02-06 Zihan Cui

Virtual support agents have grown in popularity as a way for businesses to provide better and more accessible customer service. Some challenges in this domain include ambiguous user queries as well as changing support topics and user…

机器学习 · 计算机科学 2021-12-07 Sandra Sajeev , Jade Huang , Nikos Karampatziakis , Matthew Hall , Sebastian Kochman , Weizhu Chen

We study contextual bandit (CB) problems, where the user can sometimes respond with the best action in a given context. Such an interaction arises, for example, in text prediction or autocompletion settings, where a poor suggestion is…

机器学习 · 计算机科学 2023-02-09 Alekh Agarwal , Claudio Gentile , Teodor V. Marinov

With the proliferation of electric vehicles, the electrical distribution grids are more prone to overloads. In this paper, we study an intelligent pricing and power control mechanism based on contextual bandits to provide incentives for…

其他计算机科学 · 计算机科学 2019-05-06 Christian Römer , Johannes Hiry , Chris Kittl , Thomas Liebig , Christian Rehtanz

Prediction interval (PI) is an effective tool to quantify uncertainty and usually serves as an input to downstream robust optimization. Traditional approaches focus on improving the quality of PI in the view of statistical scores and assume…

系统与控制 · 电气工程与系统科学 2023-11-30 Yufan Zhang , Honglin Wen , Qiuwei Wu

We consider an online decision making setting known as contextual bandit problem, and propose an approach for improving contextual bandit performance by using an adaptive feature extraction (representation learning) based on online…

人工智能 · 计算机科学 2020-09-15 Baihan Lin , Djallel Bouneffouf , Guillermo Cecchi , Irina Rish

We consider a contextual bandit problem with $S$ contexts and $K$ actions. In each round $t=1,2,\dots$, the learner observes a random context and chooses an action based on its past experience. The learner then observes a random reward…

机器学习 · 计算机科学 2023-11-29 Chung-Wei Lee , Qinghua Liu , Yasin Abbasi-Yadkori , Chi Jin , Tor Lattimore , Csaba Szepesvári

Contextual multi-armed bandits are classical models in reinforcement learning for sequential decision-making associated with individual information. A widely-used policy for bandits is Thompson Sampling, where samples from a data-driven…

机器学习 · 统计学 2021-11-30 Hongju Park , Mohamad Kazem Shirani Faradonbeh

The contextual duelling bandit problem models adaptive recommender systems, where the algorithm presents a set of items to the user, and the user's choice reveals their preference. This setup is well suited for implicit choices users make…

机器学习 · 计算机科学 2025-08-27 Suryanarayana Sankagiri , Jalal Etesami , Pouria Fatemi , Matthias Grossglauser

We study contextual bandit learning with an abstract policy class and continuous action space. We obtain two qualitatively different regret bounds: one competes with a smoothed version of the policy class under no continuity assumptions,…

机器学习 · 统计学 2020-06-23 Akshay Krishnamurthy , John Langford , Aleksandrs Slivkins , Chicheng Zhang

We present an adaptive learning Intelligent Tutoring System, which uses model-based reinforcement learning in the form of contextual bandits to assign learning activities to students. The model is trained on the trajectories of thousands of…

计算与语言 · 计算机科学 2022-07-29 Robert Belfer , Ekaterina Kochmar , Iulian Vlad Serban

Contextual bandits with linear payoffs, which are also known as linear bandits, provide a powerful alternative for solving practical problems of sequential decisions, e.g., online advertisements. In the era of big data, contextual data…

机器学习 · 计算机科学 2019-03-21 Xiaotian Yu

Contextual Multi-Armed Bandits is a well-known and accepted online optimization algorithm, that is used in many Web experiences to tailor content or presentation to users' traffic. Much has been published on theoretical guarantees (e.g.…

信息检索 · 计算机科学 2019-07-12 David Abensur , Ivan Balashov , Shaked Bar , Ronny Lempel , Nurit Moscovici , Ilan Orlov , Danny Rosenstein , Ido Tamir

Contextual bandits have become popular as they offer a middle ground between very simple approaches based on multi-armed bandits and very complex approaches using the full power of reinforcement learning. They have demonstrated success in…

统计方法学 · 统计学 2017-11-13 Kristjan Greenewald , Ambuj Tewari , Predrag Klasnja , Susan Murphy

Providing health monitoring devices with machine intelligence is important for enabling automatic mobile healthcare applications. However, this brings additional challenges due to the resource scarcity of these devices. This work introduces…

信号处理 · 电气工程与系统科学 2022-05-25 Berken Utku Demirel , Luke Chen , Mohammad Abdullah Al Faruque

Contextual multi-armed bandit (MAB) achieves cutting-edge performance on a variety of problems. When it comes to real-world scenarios such as recommendation system and online advertising, however, it is essential to consider the resource…

机器学习 · 计算机科学 2020-04-07 Mengyue Yang , Qingyang Li , Zhiwei Qin , Jieping Ye

We investigate contextual bandits in the presence of side-observations across arms in order to design recommendation algorithms for users connected via social networks. Users in social networks respond to their friends' activity, and hence…

机器学习 · 计算机科学 2020-10-27 Rahul Singh , Fang Liu , Xin Liu , Ness Shroff

Contextual bandits often provide simple and effective personalization in decision making problems, making them popular tools to deliver personalized interventions in mobile health as well as other health applications. However, when bandits…

机器学习 · 计算机科学 2021-07-28 Jiayu Yao , Emma Brunskill , Weiwei Pan , Susan Murphy , Finale Doshi-Velez

The bandit paradigm provides a unified modeling framework for problems that require decision-making under uncertainty. Because many business metrics can be viewed as rewards (a.k.a. utilities) that result from actions, bandit algorithms…

机器学习 · 计算机科学 2023-02-03 Bram van den Akker , Olivier Jeunen , Ying Li , Ben London , Zahra Nazari , Devesh Parekh

Contextual bandits can solve a huge range of real-world problems. However, current popular algorithms to solve them either rely on linear models, or unreliable uncertainty estimation in non-linear models, which are required to deal with the…

机器学习 · 计算机科学 2023-02-01 Adam Elwood , Marco Leonardi , Ashraf Mohamed , Alessandro Rozza