English
Related papers

Related papers: Evolutionary Multi-Armed Bandits with Genetic Thom…

200 papers

Much of the recent literature on bandit learning focuses on algorithms that aim to converge on an optimal action. One shortcoming is that this orientation does not account for time sensitivity, which can play a crucial role when learning an…

Machine Learning · Computer Science 2020-01-09 Daniel Russo , Benjamin Van Roy

Thompson sampling provides a solution to bandit problems in which new observations are allocated to arms with the posterior probability that an arm is optimal. While sometimes easy to implement and asymptotically optimal, Thompson sampling…

Machine Learning · Computer Science 2014-10-16 Dean Eckles , Maurits Kaptein

We consider a non stationary multi-armed bandit in which the population preferences are positively and negatively reinforced by the observed rewards. The objective of the algorithm is to shape the population preferences to maximize the…

Machine Learning · Computer Science 2024-03-04 Viraj Nadkarni , D. Manjunath , Sharayu Moharir

We consider a novel formulation of the multi-armed bandit model, which we call the contextual bandit with restricted context, where only a limited number of features can be accessed by the learner at every iteration. This novel formulation…

Artificial Intelligence · Computer Science 2017-06-09 Djallel Bouneffouf , Irina Rish , Guillermo A. Cecchi , Raphael Feraud

We study joint learning of network topology and a mixed opinion dynamics, in which agents may have different update rules. Such a model captures the diversity of real individual interactions. We propose a learning algorithm based on…

Social and Information Networks · Computer Science 2023-06-29 Yu Xing , Xudong Sun , Karl H. Johansson

Personalization is a crucial aspect of many online experiences. In particular, content ranking is often a key component in delivering sophisticated personalization results. Commonly, supervised learning-to-rank methods are applied, which…

Machine Learning · Computer Science 2020-04-29 Beyza Ermis , Patrick Ernst , Yannik Stein , Giovanni Zappella

Automated algorithm selection and hyperparameter tuning facilitates the application of machine learning. Traditional multi-armed bandit strategies look to the history of observed rewards to identify the most promising arms for optimizing…

Machine Learning · Computer Science 2020-05-29 Mischa Schmidt , Julia Gastinger , Sébastien Nicolas , Anett Schülke

Recent advances in contextual bandit optimization and reinforcement learning have garnered interest in applying these methods to real-world sequential decision making problems. Real-world applications frequently have constraints with…

Machine Learning · Computer Science 2019-11-05 Samuel Daulton , Shaun Singh , Vashist Avadhanula , Drew Dimmery , Eytan Bakshy

This work proposes a secure and dynamic VM allocation strategy for multi-tenant distributed systems using the Thompson sampling approach. The method proves more effective and secure compared to epsilon-greedy and upper confidence bound…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-08 Pravin Patil , Geetanjali Kale , Tanmay Karmarkar , Ruturaj Ghatage

Conducting randomized experiments in education settings raises the question of how we can use machine learning techniques to improve educational interventions. Using Multi-Armed Bandits (MAB) algorithms like Thompson Sampling (TS) in…

Machine Learning · Computer Science 2022-08-11 Fernando J. Yanez , Angela Zavaleta-Bernuy , Ziwen Han , Michael Liut , Anna Rafferty , Joseph Jay Williams

The problem of two-sided matching markets has a wide range of real-world applications and has been extensively studied in the literature. A line of recent works have focused on the problem setting where the preferences of one-side market…

Machine Learning · Computer Science 2022-05-03 Fang Kong , Junming Yin , Shuai Li

We investigate experiments that are designed to select a treatment arm for population deployment. Multi-armed bandit algorithms can enhance efficiency by dynamically allocating measurement effort towards higher performing arms based on…

Machine Learning · Computer Science 2023-08-29 Chao Qin , Daniel Russo

Training data for machine translation (MT) is often sourced from a multitude of large corpora that are multi-faceted in nature, e.g. containing contents from multiple domains or different levels of quality or complexity. Naturally, these…

Computation and Language · Computer Science 2021-10-15 Julia Kreutzer , David Vilar , Artem Sokolov

Sampling from the equilibrium distribution has always been a major problem in molecular simulations due to the very high dimensionality of conformational space. Over several decades, many approaches have been used to overcome the problem.…

Computational Physics · Physics 2020-03-02 Adrià Pérez , Pablo Herrera-Nieto , Stefan Doerr , Gianni De Fabritiis

Recently multi-armed bandit problem arises in many real-life scenarios where arms must be sampled in batches, due to limited time the agent can wait for the feedback. Such applications include biological experimentation and online…

Machine Learning · Statistics 2023-12-22 Shengyu Cao , Simai He , Ruoqing Jiang , Jin Xu , Hongsong Yuan

Users of recommender systems often behave in a non-stationary fashion, due to their evolving preferences and tastes over time. In this work, we propose a practical approach for fast personalization to non-stationary users. The key idea is…

Machine Learning · Computer Science 2020-12-02 Joey Hong , Branislav Kveton , Manzil Zaheer , Yinlam Chow , Amr Ahmed , Mohammad Ghavamzadeh , Craig Boutilier

In Reinforcement Learning (RL), multi-armed Bandit (MAB) problems have found applications across diverse domains such as recommender systems, healthcare, and finance. Traditional MAB algorithms typically assume stationary reward…

Artificial Intelligence · Computer Science 2024-10-10 Gustavo de Freitas Fonseca , Lucas Coelho e Silva , Paulo André Lima de Castro

Thompson sampling is an algorithm for online decision problems where actions are taken sequentially in a manner that must balance between exploiting what is known to maximize immediate performance and investing to accumulate new information…

Machine Learning · Computer Science 2020-07-16 Daniel Russo , Benjamin Van Roy , Abbas Kazerouni , Ian Osband , Zheng Wen

During online decision making in Multi-Armed Bandits (MAB), one needs to conduct inference on the true mean reward of each arm based on data collected so far at each step. However, since the arms are adaptively selected--thereby yielding…

Machine Learning · Computer Science 2021-06-29 Maria Dimakopoulou , Zhimei Ren , Zhengyuan Zhou

In machine learning, the notion of multi-armed bandits refers to a class of online learning problems, in which an agent is supposed to simultaneously explore and exploit a given set of choice alternatives in the course of a sequential…

Machine Learning · Computer Science 2021-07-13 Viktor Bengs , Robert Busa-Fekete , Adil El Mesaoudi-Paul , Eyke Hüllermeier