English
Related papers

Related papers: Recommendation System-based Upper Confidence Bound…

200 papers

We study the problem of training an accurate linear regression model by procuring labels from multiple noisy crowd annotators, under a budget constraint. We propose a Bayesian model for linear regression in crowdsourcing and use variational…

Machine Learning · Computer Science 2016-02-01 Divya Padmanabhan , Satyanath Bhat , Dinesh Garg , Shirish Shevade , Y. Narahari

In this paper, we propose a cost-aware cascading bandits model, a new variant of multi-armed ban- dits with cascading feedback, by considering the random cost of pulling arms. In each step, the learning agent chooses an ordered list of…

Machine Learning · Computer Science 2018-05-23 Ruida Zhou , Chao Gan , Jing Yan , Cong Shen

In this work, we address the open problem of finding low-complexity near-optimal multi-armed bandit algorithms for sequential decision making problems. Existing bandit algorithms are either sub-optimal and computationally simple (e.g.,…

Machine Learning · Computer Science 2018-04-18 Fang Liu , Sinong Wang , Swapna Buccapatnam , Ness Shroff

We introduce in this paper a new algorithm for Multi-Armed Bandit (MAB) problems. A machine learning paradigm popular within Cognitive Network related topics (e.g., Spectrum Sensing and Allocation). We focus on the case where the rewards…

Machine Learning · Statistics 2012-04-10 Wassim Jouini , Christophe Moy

In this paper, we develop a recommender system for a game that suggests potential items to players based on their interactive behaviors to maximize revenue for the game provider. Our approach is built on a reinforcement learning-based…

Artificial Intelligence · Computer Science 2021-11-18 Hung Nguyen , Minh Nguyen , Long Pham , Jennifer Adorno Nieves

Conversational recommender systems (CRS) enable the traditional recommender systems to explicitly acquire user preferences towards items and attributes through interactive conversations. Reinforcement learning (RL) is widely adopted to…

Information Retrieval · Computer Science 2021-05-21 Yang Deng , Yaliang Li , Fei Sun , Bolin Ding , Wai Lam

Exposure bias is a well-known issue in recommender systems where items and suppliers are not equally represented in the recommendation results. This is especially problematic when bias is amplified over time as a few popular items are…

Information Retrieval · Computer Science 2021-08-10 Masoud Mansoury , Himan Abdollahpouri , Bamshad Mobasher , Mykola Pechenizkiy , Robin Burke , Milad Sabouri

Bayesian Optimization is critically vulnerable to extreme outliers. Existing provably robust methods typically assume a bounded cumulative corruption budget, which makes them defenseless against even a single corruption of sufficient…

Machine Learning · Statistics 2026-02-17 Abdelhamid Ezzerg , Ilija Bogunovic , Jeremias Knoblauch

The design of personalized incentives or recommendations to improve user engagement is gaining prominence as digital platform providers continually emerge. We propose a multi-armed bandit framework for matching incentives to users, whose…

Machine Learning · Computer Science 2018-07-09 Tanner Fiez , Shreyas Sekar , Liyuan Zheng , Lillian J. Ratliff

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by applications in clinical trials and recommendation systems, we assume that two arms are connected if and only if they are similar (i.e.,…

Machine Learning · Computer Science 2025-09-18 Han Qi , Fei Guo , Li Zhu , Qiaosheng Zhang

Due to the broad range of applications of stochastic multi-armed bandit model, understanding the effects of adversarial attacks and designing bandit algorithms robust to attacks are essential for the safe applications of this model. In this…

Machine Learning · Computer Science 2020-10-28 Guanlin Liu , Lifeng lai

The paper proposes a novel upper confidence bound (UCB) procedure for identifying the arm with the largest mean in a multi-armed bandit game in the fixed confidence setting using a small number of total samples. The procedure cannot be…

Machine Learning · Statistics 2013-12-30 Kevin Jamieson , Matthew Malloy , Robert Nowak , Sébastien Bubeck

In this study, we propose a new method for constructing UCB-type algorithms for stochastic multi-armed bandits based on general convex optimization methods with an inexact oracle. We derive the regret bounds corresponding to the convergence…

Machine Learning · Computer Science 2024-02-13 Yuriy Dorn , Aleksandr Katrutsa , Ilgam Latypov , Andrey Pudovikov

The Rising Multi-Armed Bandit (RMAB) framework models environments where expected rewards of arms increase with plays, which models practical scenarios where performance of each option improves with the repeated usage, such as in robotics…

Machine Learning · Computer Science 2026-02-16 Seockbean Song , Chenyu Gan , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

The last decade has witnessed many successes of deep learning-based models for industry-scale recommender systems. These models are typically trained offline in a batch manner. While being effective in capturing users' past interactions…

Recommender systems play a crucial role in internet economies by connecting users with relevant products. However, designing effective recommender systems faces the key challenges: the exploration-exploitation tradeoff in securing incentive…

Information Retrieval · Computer Science 2026-05-26 Yuantong Li , Guang Cheng , Xiaowu Dai

We provide a simple method to combine stochastic bandit algorithms. Our approach is based on a "meta-UCB" procedure that treats each of $N$ individual bandit algorithms as arms in a higher-level $N$-armed bandit problem that we solve with a…

Machine Learning · Computer Science 2020-12-25 Ashok Cutkosky , Abhimanyu Das , Manish Purohit

Stochastic Rising Bandits (SRBs) model sequential decision-making problems in which the expected reward of the available options increases every time they are selected. This setting captures a wide range of scenarios in which the available…

Machine Learning · Computer Science 2024-05-29 Marco Mussi , Alessandro Montenegro , Francesco Trovó , Marcello Restelli , Alberto Maria Metelli

In many application domains (e.g., recommender systems, intelligent tutoring systems), the rewards associated to the actions tend to decrease over time. This decay is either caused by the actions executed in the past (e.g., a user may get…

Machine Learning · Statistics 2026-04-24 Julien Seznec , Pierre Ménard , Alessandro Lazaric , Michal Valko

Recommender Systems (RSs) are exploited by various business enterprises to suggest their products (items) to consumers (users). Collaborative filtering (CF) is a widely used variant of RSs which learns hidden patterns from user-item…

Information Retrieval · Computer Science 2026-03-17 Nikita Baidya , Bidyut Kr. Patra , Ratnakar Dash