English
Related papers

Related papers: reBandit: Random Effects based Online RL algorithm…

200 papers

We propose a reinforcement learning (RL)-based system that would automatically prescribe a hypothetical patient medication that may help the patient with their mental health-related speech disfluency, and adjust the medication and the…

Reinforcement learning (RL) has achieved remarkable success in real-world decision-making across diverse domains, including gaming, robotics, online advertising, public health, and natural language processing. Despite these advances, a…

Applications · Statistics 2026-01-23 Asim H. Gazi , Yongyi Guo , Daiqi Gao , Ziping Xu , Kelly W. Zhang , Susan A. Murphy

Applying Reinforcement Learning (RL) to Restless Multi-Arm Bandits (RMABs) offers a promising avenue for addressing allocation problems with resource constraints and temporal dynamics. However, classic RMAB models largely overlook the…

Machine Learning · Computer Science 2025-03-20 Yunfan Zhao , Tonghan Wang , Dheeraj Nagaraj , Aparna Taneja , Milind Tambe

Reinforcement learning (RL) is a type of artificial intelligence for making optimal choices. In healthcare, researchers generally use offline RL (ORL), where models are trained and evaluated from retrospective observational data. To…

Machine Learning · Computer Science 2026-04-30 Thomas Frost , Hrisheekesh Vaidya , Steve Harris

Restless multi-armed bandits (RMABs) are a popular framework for algorithmic decision making in sequential settings with limited resources. RMABs are increasingly being used for sensitive decisions such as in public health, treatment…

Machine Learning · Computer Science 2023-08-22 Jackson A. Killian , Manish Jain , Yugang Jia , Jonathan Amar , Erich Huang , Milind Tambe

The widespread adoption of effective hybrid closed loop systems would represent an important milestone of care for people living with type 1 diabetes (T1D). These devices typically utilise simple control algorithms to select the optimal…

Machine Learning · Computer Science 2023-05-08 Harry Emerson , Matthew Guy , Ryan McConville

In many real-world applications of reinforcement learning (RL), performing actions requires consuming certain types of resources that are non-replenishable in each episode. Typical applications include robotic control with limited energy…

Machine Learning · Computer Science 2022-12-15 Zhihai Wang , Taoxing Pan , Qi Zhou , Jie Wang

Online reinforcement learning (RL) algorithms are increasingly used to personalize digital interventions in the fields of mobile health and online education. Common challenges in designing and testing an RL algorithm in these settings…

Machine Learning · Computer Science 2022-09-01 Anna L. Trella , Kelly W. Zhang , Inbal Nahum-Shani , Vivek Shetty , Finale Doshi-Velez , Susan A. Murphy

Computational drug repurposing for rare diseases is especially challenging when no prior associations exist between drugs and target diseases. Therefore, knowledge graph completion and message-passing GNNs have little reliable signal to…

Artificial Intelligence · Computer Science 2025-10-17 Lang Qin , Zijian Gan , Xu Cao , Pengcheng Jiang , Yankai Jiang , Jiawei Han , Kaishun Wu , Jintai Chen

Dental disease is a prevalent chronic condition associated with substantial financial burden, personal suffering, and increased risk of systemic diseases. Despite widespread recommendations for twice-daily tooth brushing, adherence to…

Artificial Intelligence · Computer Science 2024-12-20 Anna L. Trella , Kelly W. Zhang , Hinal Jajal , Inbal Nahum-Shani , Vivek Shetty , Finale Doshi-Velez , Susan A. Murphy

Type 1 Diabetes (T1D) management requires continuous adjustment of insulin and lifestyle behaviors to maintain blood glucose within a safe target range. Although automated insulin delivery (AID) systems have improved glycemic outcomes, many…

In mobile health (mHealth) smart devices deliver behavioral treatments repeatedly over time to a user with the goal of helping the user adopt and maintain healthy behaviors. Reinforcement learning appears ideal for learning how to optimally…

Machine Learning · Computer Science 2020-12-15 Sabina Tomkins , Peng Liao , Predrag Klasnja , Susan Murphy

Contextual bandit learning is a reinforcement learning problem where the learner repeatedly receives a set of features (context), takes an action and receives a reward based on the action and context. We consider this problem under a…

Machine Learning · Computer Science 2012-03-05 Alekh Agarwal , Miroslav Dudík , Satyen Kale , John Langford , Robert E. Schapire

This paper studies bandit problems where an agent has access to offline data that might be utilized to potentially improve the estimation of each arm's reward distribution. A major obstacle in this setting is the existence of compound…

Machine Learning · Computer Science 2023-12-21 Wen Huang , Xintao Wu

Quantum control is concerned with the realisation of desired dynamics in quantum systems, serving as a linchpin for advancing quantum technologies and fundamental research. Analytic approaches and standard optimisation algorithms do not…

Quantum Physics · Physics 2025-05-29 Jan Ole Ernst , Aniket Chatterjee , Tim Franzmeyer , Axel Kuhn

We propose a new bootstrap-based online algorithm for stochastic linear bandit problems. The key idea is to adopt residual bootstrap exploration, in which the agent estimates the next step reward by re-sampling the residuals of mean reward…

Machine Learning · Statistics 2022-06-20 Shuang Wu , Chi-Hua Wang , Yuantong Li , Guang Cheng

Traffic signal control is a significant part of the construction of intelligent transportation. An efficient traffic signal control strategy can reduce traffic congestion, improve urban road traffic efficiency and facilitate people's lives.…

Machine Learning · Computer Science 2022-03-14 Ruijie Qi , Jianbin Huang , He Li , Qinglin Tan , Longji Huang , Jiangtao Cui

Motivated by the emerging needs of personalized preventative intervention in many healthcare applications, we consider a multi-stage, dynamic decision-making problem in the online setting with unknown model parameters. To deal with the…

Machine Learning · Computer Science 2022-11-17 Xinyun Chen , Pengyi Shi , Shanwen Pu

Multi-armed bandit models have proven to be useful in modeling many real world problems in the areas of control and sequential decision making with partial information. However, in many scenarios, such as those prevalent in healthcare and…

Optimization and Control · Mathematics 2024-08-27 Qinyang He , Yonatan Mintz

Autoregressive processes naturally arise in a large variety of real-world scenarios, including stock markets, sales forecasting, weather prediction, advertising, and pricing. When facing a sequential decision-making problem in such a…