English
Related papers

Related papers: Applying Multi-armed Bandit Algorithms to Computat…

200 papers

In online algorithm selection (OAS), instances of an algorithmic problem class are presented to an agent one after another, and the agent has to quickly select a presumably best algorithm from a fixed set of candidate algorithms. For…

Machine Learning · Computer Science 2021-09-15 Alexander Tornede , Viktor Bengs , Eyke Hüllermeier

Multi-armed bandits (MAB) and causal MABs (CMAB) are established frameworks for decision-making problems. The majority of prior work typically studies and solves individual MAB and CMAB in isolation for a given problem and associated data.…

Recent works on Multi-Armed Bandits (MAB) and Combinatorial Multi-Armed Bandits (COM-MAB) show good results on a global accuracy metric. This can be achieved, in the case of recommender systems, with personalization. However, with a…

Machine Learning · Computer Science 2020-09-17 Alexandre Letard , Tassadit Amghar , Olivier Camp , Nicolas Gutowski

In many web applications, a recommendation is not a single item suggested to a user but a list of possibly interesting contents that may be ranked in some contexts. The combinatorial bandit problem has been studied quite extensively these…

Data Structures and Algorithms · Computer Science 2016-05-27 Hossein Vahabi , Paul Lagrée , Claire Vernade , Olivier Cappé

We study the problem of online learning in two-sided non-stationary matching markets, where the objective is to converge to a stable match. In particular, we consider the setting where one side of the market, the arms, has fixed known set…

Machine Learning · Computer Science 2023-01-16 Deepan Muthirayan , Chinmay Maheshwari , Pramod P. Khargonekar , Shankar Sastry

E-commerce sites strive to provide users the most timely relevant information in order to reduce shopping frictions and increase customer satisfaction. Multi armed bandit models (MAB) as a type of adaptive optimization algorithms provide…

Information Retrieval · Computer Science 2021-08-23 Ding Xiang , Becky West , Jiaqi Wang , Xiquan Cui , Jinzhou Huang

Personalization is a crucial aspect of many online experiences. In particular, content ranking is often a key component in delivering sophisticated personalization results. Commonly, supervised learning-to-rank methods are applied, which…

Machine Learning · Computer Science 2020-04-29 Beyza Ermis , Patrick Ernst , Yannik Stein , Giovanni Zappella

The deployment of Multi-Armed Bandits (MAB) has become commonplace in many economic applications. However, regret guarantees for even state-of-the-art linear bandit algorithms (such as Optimism in the Face of Uncertainty Linear bandit…

Econometrics · Economics 2023-02-28 Jingwen Zhang , Yifang Chen , Amandeep Singh

The task of computational advertising is to select the most suitable advertisement candidate from a set of possible options. The candidate is selected in such a way that the user is most likely to positively react to it: click and perform…

Information Retrieval · Computer Science 2017-12-11 Alexey Grigorev

Personalization enables businesses to learn customer preferences from past interactions and thus to target individual customers with more relevant content. We consider the problem of predicting the optimal promotional offer for a given…

Machine Learning · Computer Science 2022-02-02 Aleksey A. Kocherzhenko , Nirmal Sobha Kartha , Tengfei Li , Hsin-Yi , Shih , Marco Mandic , Mike Fuller , Arshak Navruzyan

Contextual bandit algorithms are commonly used in digital health to recommend personalized treatments. However, to ensure the effectiveness of the treatments, patients are often requested to take actions that have no immediate benefit to…

Machine Learning · Computer Science 2024-03-14 Kyra Gan , Esmaeil Keyvanshokooh , Xueqing Liu , Susan Murphy

We study a variant of the classical stochastic $K$-armed bandit where observing the outcome of each arm is expensive, but cheap approximations to this outcome are available. For example, in online advertising the performance of an ad can be…

Machine Learning · Computer Science 2016-11-01 Kirthevasan Kandasamy , Gautam Dasarathy , Jeff Schneider , Barnabás Póczos

In a multi-armed bandit problem, an online algorithm chooses from a set of strategies in a sequence of trials so as to maximize the total payoff of the chosen strategies. While the performance of bandit algorithms with a small finite…

Data Structures and Algorithms · Computer Science 2008-09-30 Robert Kleinberg , Aleksandrs Slivkins , Eli Upfal

Personalized web services strive to adapt their services (advertisements, news articles, etc) to individual users by making use of both content and user information. Despite a few recent advances, this problem remains challenging for at…

Machine Learning · Computer Science 2012-03-05 Lihong Li , Wei Chu , John Langford , Robert E. Schapire

Online advertising, as the vast market, has gained significant attention in various platforms ranging from search engines, third-party websites, social media, and mobile apps. The prosperity of online campaigns is a challenge in online…

Social and Information Networks · Computer Science 2021-08-23 Zhabiz Gharibshah , Xingquan Zhu

Matching problems have been widely studied in the research community, especially Ad-Auctions with many applications ranging from network design to advertising. Following the various advancements in machine learning, one natural question is…

Data Structures and Algorithms · Computer Science 2024-02-15 Eniko Kevi , Nguyen Kim Thang

Real-time bidding (RTB) based display advertising has become one of the key technological advances in computational advertising. RTB enables advertisers to buy individual ad impressions via an auction in real-time and facilitates the…

Computer Science and Game Theory · Computer Science 2018-03-13 Kan Ren , Weinan Zhang , Ke Chang , Yifei Rong , Yong Yu , Jun Wang

A matching platform is a system that matches different types of participants, such as companies and job-seekers. In such a platform, merely maximizing the number of matches can result in matches being concentrated on highly popular…

Machine Learning · Computer Science 2026-03-10 Yuki Shibukawa , Koichi Tanaka , Yuta Saito , Shinji Ito

Modeling what makes an advertisement persuasive, i.e., eliciting the desired response from consumer, is critical to the study of propaganda, social psychology, and marketing. Despite its importance, computational modeling of persuasion in…

Ranking system is the core part of modern retrieval and recommender systems, where the goal is to rank candidate items given user contexts. Optimizing ranking systems online means that the deployed system can serve user requests, e.g.,…

Information Retrieval · Computer Science 2021-10-13 Chang Li