English
Related papers

Related papers: Compositional Q-learning for electrolyte repletion…

200 papers

Reinforcement learning (RL) has helped improve decision-making in several applications. However, applying traditional RL is challenging in some applications, such as rehabilitation of people with a spinal cord injury (SCI). Among other…

Machine Learning · Computer Science 2023-10-24 Nathan Phelps , Stephanie Marrocco , Stephanie Cornell , Dalton L. Wolfe , Daniel J. Lizotte

Many reinforcement learning (RL) applications have combinatorial action spaces, where each action is a composition of sub-actions. A standard RL approach ignores this inherent factorization structure, resulting in a potential failure to…

Machine Learning · Computer Science 2023-05-04 Shengpu Tang , Maggie Makar , Michael W. Sjoding , Finale Doshi-Velez , Jenna Wiens

Reinforcement learning (RL) for complex tasks remains a challenge, primarily due to the difficulties of engineering scalar reward functions and the inherent inefficiency of training models from scratch. Instead, it would be better to…

Artificial Intelligence · Computer Science 2024-05-03 Finn Rietz , Erik Schaffernicht , Stefan Heinrich , Johannes Andreas Stork

Federated Learning (FL) systems evolve in heterogeneous and ever-evolving environments that challenge their performance. Under real deployments, the learning tasks of clients can also evolve with time, which calls for the integration of…

Machine Learning · Computer Science 2024-06-05 Bart Cox , Jeroen Galjaard , Aditya Shankar , Jérémie Decouchant , Lydia Y. Chen

In off-policy policy evaluation (OPE) tasks within reinforcement learning, Temporal Difference Learning(TD) and Fitted Q-Iteration (FQI) have traditionally been viewed as differing in the number of updates toward the target value function:…

Machine Learning · Computer Science 2025-12-02 Zechen Wu , Amy Greenwald , Ronald Parr

Multi-Agent Reinforcement Learning (MARL) is useful in many problems that require the cooperation and coordination of multiple agents. Learning optimal policies using reinforcement learning in a multi-agent setting can be very difficult as…

Machine Learning · Computer Science 2022-05-31 Rafael Pina , Varuna De Silva , Joosep Hook , Ahmet Kondoz

Recent disentangled representation learning (DRL) methods heavily rely on factor specific strategies-either learning objectives for attributes or model architectures for objects-to embed inductive biases. Such divergent approaches result in…

Machine Learning · Computer Science 2025-11-12 Whie Jung , Dong Hoon Lee , Seunghoon Hong

We propose a framework for verifiable and compositional reinforcement learning (RL) in which a collection of RL subsystems, each of which learns to accomplish a separate subtask, are composed to achieve an overall task. The framework…

Machine Learning · Computer Science 2022-05-16 Cyrus Neary , Christos Verginis , Murat Cubuktepe , Ufuk Topcu

Model-free deep reinforcement learning has been shown to exhibit good performance in domains ranging from video games to simulated robotic manipulation and locomotion. However, model-free methods are known to perform poorly when the…

Machine Learning · Computer Science 2018-03-20 Tuomas Haarnoja , Vitchyr Pong , Aurick Zhou , Murtaza Dalal , Pieter Abbeel , Sergey Levine

A common strategy to deal with the expensive reinforcement learning (RL) of complex tasks is to decompose them into a collection of subtasks that are usually simpler to learn as well as reusable for new problems. However, when a robot…

Robotics · Computer Science 2019-08-02 Domingo Esteban , Leonel Rozo , Darwin G. Caldwell

Medical treatments often involve a sequence of decisions, each informed by previous outcomes. This process closely aligns with reinforcement learning (RL), a framework for optimizing sequential decisions to maximize cumulative rewards under…

Machine Learning · Computer Science 2024-10-15 Ali Shirali , Alexander Schubert , Ahmed Alaa

Comparative evaluation of multiple dynamic treatment policies is essential for healthcare and policy decisions, yet conventional longitudinal causal inference methods estimate each in isolation, preventing information sharing across…

Machine Learning · Computer Science 2026-05-28 Wenxin Chen , Weishen Pan , Kyra Gan , Fei Wang

Reinforcement learning (RL) has seen significant research and application results but often requires large amounts of training data. This paper proposes two data-efficient off-policy RL methods that use parametrized Q-learning. In these…

Systems and Control · Electrical Eng. & Systems 2025-04-09 J. S. van Hulst , W. P. M. H. Heemels , D. J. Antunes

We present *-CFQ ("star-CFQ"): a suite of large-scale datasets of varying scope based on the CFQ semantic parsing benchmark, designed for principled investigation of the scalability of machine learning systems in a realistic compositional…

Machine Learning · Computer Science 2020-12-16 Dmitry Tsarkov , Tibor Tihon , Nathan Scales , Nikola Momchev , Danila Sinopalnikov , Nathanael Schärli

This article revisits the 20-year-old neural fitted Q-iteration (NFQ) algorithm on its classical CartPole benchmark. NFQ was a pioneering approach towards modern Deep Reinforcement Learning (Deep RL) in applying multi-layer neural networks…

Machine Learning · Computer Science 2025-11-18 Sascha Lange , Roland Hafner , Martin Riedmiller

In 5G networks, network slicing has emerged as a pivotal paradigm to address diverse user demands and service requirements. To meet the requirements, reinforcement learning (RL) algorithms have been utilized widely, but this method has the…

Networking and Internet Architecture · Computer Science 2024-08-21 Shavbo Salehi , Pedro Enrique Iturria-Rivera , Medhat Elsayed , Majid Bavand , Raimundas Gaigalas , Yigit Ozcan , Melike Erol-Kantarci

Continual learning (CL) aims to constantly learn new knowledge over time while avoiding catastrophic forgetting on old tasks. In this work, we focus on continual text classification under the class-incremental setting. Recent CL studies…

Computation and Language · Computer Science 2023-05-15 Yifan Song , Peiyi Wang , Dawei Zhu , Tianyu Liu , Zhifang Sui , Sujian Li

Reinforcement learning (RL) algorithms usually require a substantial amount of interaction data and perform well only for specific tasks in a fixed environment. In some scenarios such as healthcare, however, usually only few records are…

Machine Learning · Computer Science 2020-12-17 Chaochao Lu , Biwei Huang , Ke Wang , José Miguel Hernández-Lobato , Kun Zhang , Bernhard Schölkopf

To effectively implement quantum algorithms on noisy intermediate-scale quantum (NISQ) processors is a central task in modern quantum technology. NISQ processors feature tens to a few hundreds of noisy qubits with limited coherence times…

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because…

Information Retrieval · Computer Science 2023-03-13 Ziru Liu , Jiejie Tian , Qingpeng Cai , Xiangyu Zhao , Jingtong Gao , Shuchang Liu , Dayou Chen , Tonghao He , Dong Zheng , Peng Jiang , Kun Gai