English
Related papers

Related papers: Estimation of Warfarin Dosage with Reinforcement L…

200 papers

We consider applying multi-armed bandits to model-assisted designs for dose-finding clinical trials. Multi-armed bandits are very simple and powerful methods to determine actions to maximize a reward in a limited number of trials. Among the…

Methodology · Statistics 2022-01-17 Masahiro Kojima

Determining what experience to generate to best facilitate learning (i.e. exploration) is one of the distinguishing features and open challenges in reinforcement learning. The advent of distributed agents that interact with parallel…

Machine Learning · Computer Science 2019-12-17 Tom Schaul , Diana Borsa , David Ding , David Szepesvari , Georg Ostrovski , Will Dabney , Simon Osindero

In this paper, we investigate a new multi-armed bandit (MAB) online learning model that considers real-world phenomena in many recommender systems: (i) the learning agent cannot pull the arms by itself and thus has to offer rewards to users…

Machine Learning · Computer Science 2021-06-01 Tianchen Zhou , Jia Liu , Chaosheng Dong , Jingyuan Deng

In modern ML Ops environments, model deployment is a critical process that traditionally relies on static heuristics such as validation error comparisons and A/B testing. However, these methods require human intervention to adapt to…

Machine Learning · Computer Science 2025-03-31 S. Aaron McClendon , Vishaal Venkatesh , Juan Morinelli

Medical automatic diagnosis aims to imitate human doctors in real-world diagnostic processes and to achieve accurate diagnoses by interacting with the patients. The task is formulated as a sequential decision-making problem with a series of…

Machine Learning · Computer Science 2022-06-07 Hongyi Yuan , Sheng Yu

Most algorithms for the multi-armed bandit problem in reinforcement learning aimed to maximize the expected reward, which are thus useful in searching the optimized candidate with the highest reward (function value) for diverse applications…

Machine Learning · Computer Science 2022-01-03 Bin Chong , Yingguang Yang , Zi-Le Wang , Hang Xing , Zhirong Liu

People with type 1 diabetes (T1D) struggle to calculate the optimal insulin dose at mealtime, especially when under multiple daily injections (MDI) therapy. Effectively, they will not always perform rigorous and precise calculations, but…

Artificial Intelligence · Computer Science 2023-09-19 Anas El Fathi , Marc D. Breton

In fields such as medicine and social sciences, the goal of treatment is often to maintain the outcome of interest within a desirable range rather than to optimize its value. To achieve this, it may be more practical to recommend a…

Methodology · Statistics 2025-02-17 Chan Park , Guanhua Chen , Menggang Yu

Advances in reinforcement learning research have demonstrated the ways in which different agent-based models can learn how to optimally perform a task within a given environment. Reinforcement leaning solves unsupervised problems where…

Machine Learning · Computer Science 2022-11-03 Herkulaas Combrink , Vukosi Marivate , Benjamin Rosman

In recent years, reinforcement learning and bandits have transformed a wide range of real-world applications including healthcare, finance, recommendation systems, robotics, and last but not least, the speech and natural language…

Artificial Intelligence · Computer Science 2023-10-20 Baihan Lin

Personalization is a crucial aspect of many online experiences. In particular, content ranking is often a key component in delivering sophisticated personalization results. Commonly, supervised learning-to-rank methods are applied, which…

Machine Learning · Computer Science 2020-04-29 Beyza Ermis , Patrick Ernst , Yannik Stein , Giovanni Zappella

Randomized experiments (a.k.a. A/B tests) are a powerful tool for estimating treatment effects, to inform decisions making in business, healthcare and other applications. In many problems, the treatment has a lasting effect that evolves…

Machine Learning · Computer Science 2022-10-17 Ziyang Tang , Yiheng Duan , Stephanie Zhang , Lihong Li

Traditional online learning models are typically initialized from scratch. By contrast, contemporary real-world applications often have access to historical datasets that can potentially enhanced the online learning processes. We study how…

Machine Learning · Computer Science 2025-12-19 Wang Chi Cheung , Lixing Lyu

We propose a reinforcement learning based scheduling framework for Restless Multi-Armed Bandit (RMAB) problems, centred on a Whittle Index Q-Learning policy with Upper Confidence Bound (UCB) exploration, referred to as WIQL-UCB. Unlike…

Systems and Control · Electrical Eng. & Systems 2026-01-14 Sokipriala Jonah , Seong Ki Yoo , Saurav Sthapit

A fundamental question for companies with large amount of logged data is: How to use such logged data together with incoming streaming data to make good decisions? Many companies currently make decisions via online A/B tests, but wrong…

Machine Learning · Computer Science 2020-11-10 Li Ye , Yishi Lin , Hong Xie , John C. S. Lui

We investigate the problem of learning an equilibrium in a generalized two-sided matching market, where agents can adaptively choose their actions based on their assigned matches. Specifically, we consider a setting in which matched agents…

Machine Learning · Computer Science 2025-06-05 Andreas Athanasopoulos , Christos Dimitrakakis

The stochastic multi-armed bandit problem is a well-known model for studying the exploration-exploitation trade-off. It has significant possible applications in adaptive clinical trials, which allow for dynamic changes in the treatment…

Machine Learning · Computer Science 2019-06-11 Hossein Aboutalebi , Doina Precup , Tibor Schuster

A novel reinforcement learning algorithm is introduced for multiarmed restless bandits with average reward, using the paradigms of Q-learning and Whittle index. Specifically, we leverage the structure of the Whittle index policy to reduce…

Machine Learning · Computer Science 2021-09-22 Konstantin E. Avrachenkov , Vivek S. Borkar

An accurate and fast estimation of the available bandwidth in a network with varying cross-traffic is a challenging task. The accepted probing tools, based on the fluid-flow model of a bottleneck link with first-in, first-out multiplexing,…

Networking and Internet Architecture · Computer Science 2019-06-18 Sukhpreet Kaur Khangura , Sami Akın

In this work, we present our various contributions to the objective of building a decision support tool for the diagnosis of rare diseases. Our goal is to achieve a state of knowledge where the uncertainty about the patient's disease is…