English
Related papers

Related papers: Counterfactual Conservative Q Learning for Offline…

200 papers

Most offline reinforcement learning (RL) methods suffer from the trade-off between improving the policy to surpass the behavior policy and constraining the policy to limit the deviation from the behavior policy as computing $Q$-values using…

Machine Learning · Computer Science 2023-03-29 Haoran Xu , Li Jiang , Jianxiong Li , Zhuoran Yang , Zhaoran Wang , Victor Wai Kin Chan , Xianyuan Zhan

We study offline multitask representation learning in reinforcement learning (RL), where a learner is provided with an offline dataset from different tasks that share a common representation and is asked to learn the shared representation.…

Machine Learning · Computer Science 2024-11-01 Haque Ishfaq , Thanh Nguyen-Tang , Songtao Feng , Raman Arora , Mengdi Wang , Ming Yin , Doina Precup

Prior authorization (PA) requires interpretation of complex and fragmented coverage policies, yet existing retrieval-augmented systems rely on static top-$K$ strategies with fixed numbers of retrieved sections. Such fixed retrieval can be…

Information Retrieval · Computer Science 2026-04-08 Ruslan Sharifullin , Maxim Gorshkov , Hannah Clay

We introduce Coarse Q-learning (CQL), a reinforcement-learning model for bandit problems with stochastically varying menus. Alternatives are exogenously partitioned into similarity classes, and feedback from sampled alternatives is pooled…

Theoretical Economics · Economics 2026-05-13 Philippe Jehiel , Aviman Satpathy

Offline Reinforcement Learning (RL) is structured to derive policies from static trajectory data without requiring real-time environment interactions. Recent studies have shown the feasibility of framing offline RL as a sequence modeling…

Machine Learning · Computer Science 2023-09-01 Abdelghani Ghanem , Philippe Ciblat , Mounir Ghogho

Model-based reinforcement learning (RL) methods are appealing in the offline setting because they allow an agent to reason about the consequences of actions without interacting with the environment. Prior methods learn a 1-step dynamics…

Machine Learning · Computer Science 2022-11-07 Bogdan Mazoure , Benjamin Eysenbach , Ofir Nachum , Jonathan Tompson

Mechanical ventilation is a key form of life support for patients with pulmonary impairment. Healthcare workers are required to continuously adjust ventilator settings for each patient, a challenging and time consuming task. Hence, it would…

Machine Learning · Computer Science 2022-10-07 Flemming Kondrup , Thomas Jiralerspong , Elaine Lau , Nathan de Lara , Jacob Shkrob , My Duc Tran , Doina Precup , Sumana Basu

Offline cooperative multi-agent reinforcement learning (MARL) faces unique challenges due to distributional shifts, particularly stemming from the high dimensionality of joint action spaces and the presence of out-of-distribution joint…

Machine Learning · Computer Science 2026-05-29 Dan Qiao , Wenhao Li , Shanchao Yang , Hongyuan Zha , Baoxiang Wang

The next-generation wireless technologies, including beyond 5G and 6G networks, are paving the way for transformative applications such as vehicle platooning, smart cities, and remote surgery. These innovations are driven by a vast array of…

Multiagent Systems · Computer Science 2026-01-05 Eslam Eldeeb , Hirley Alves

We present Q-chunking, a simple yet effective recipe for improving reinforcement learning (RL) algorithms for long-horizon, sparse-reward tasks. Our recipe is designed for the offline-to-online RL setting, where the goal is to leverage an…

Machine Learning · Computer Science 2026-05-12 Qiyang Li , Zhiyuan Zhou , Sergey Levine

Offline reinforcement learning (RL) presents a promising approach for learning reinforced policies from offline datasets without the need for costly or unsafe interactions with the environment. However, datasets collected by humans in…

Machine Learning · Computer Science 2024-03-12 Rui Yang , Han Zhong , Jiawei Xu , Amy Zhang , Chongjie Zhang , Lei Han , Tong Zhang

Learning representations for reinforcement learning (RL) has shown much promise for continuous control. We propose an efficient representation learning method using only a self-supervised latent-state consistency loss. Our approach employs…

Machine Learning · Computer Science 2024-06-06 Aidan Scannell , Kalle Kujanpää , Yi Zhao , Mohammadreza Nakhaei , Arno Solin , Joni Pajarinen

Offline reinforcement learning (RL) aims to learn decision policies from a fixed batch of logged transitions, without additional environment interaction. Despite remarkable empirical progress, offline RL remains fragile under distribution…

Methodology · Statistics 2026-03-16 Debashis Chatterjee

We present a model-based offline reinforcement learning policy performance lower bound that explicitly captures dynamics model misspecification and distribution mismatch and we propose an empirical algorithm for optimal offline policy…

Machine Learning · Computer Science 2023-01-30 Kefan Dong , Yannis Flet-Berliac , Allen Nie , Emma Brunskill

We study the offline meta-reinforcement learning (OMRL) problem, a paradigm which enables reinforcement learning (RL) algorithms to quickly adapt to unseen tasks without any interactions with the environments, making RL truly practical in…

Machine Learning · Computer Science 2021-05-07 Lanqing Li , Rui Yang , Dijun Luo

The rapid growth of heterogeneous and massive wireless connectivity in 6G networks demands intelligent solutions to ensure scalability, reliability, privacy, ultra-low latency, and effective control. Although artificial intelligence (AI)…

Machine Learning · Computer Science 2025-04-08 Eslam Eldeeb , Hirley Alves

Offline reinforcement learning (RL) learns policies from fixed datasets without online interactions, but suffers from distribution shift, causing inaccurate evaluation and overestimation of out-of-distribution (OOD) actions. Existing…

Machine Learning · Computer Science 2025-10-07 Xuyang Chen , Keyu Yan , Wenhan Cao , Lin Zhao

In many computational science and engineering applications, the output of a system of interest corresponding to a given input can be queried at different levels of fidelity with different costs. Typically, low-fidelity data is cheap and…

Machine Learning · Computer Science 2022-06-13 Sami Khairy , Prasanna Balaprakash

Inspired by the recent successes of Inverse Optimization (IO) across various application domains, we propose a novel offline Reinforcement Learning (ORL) algorithm for continuous state and action spaces, leveraging the convex loss function…

Machine Learning · Computer Science 2026-03-19 Ioannis Dimanidis , Tolga Ok , Peyman Mohajerin Esfahani

Designing efficient algorithms for multi-agent reinforcement learning (MARL) is fundamentally challenging because the size of the joint state and action spaces grows exponentially in the number of agents. These difficulties are exacerbated…

Machine Learning · Computer Science 2025-10-27 Emile Anand , Ishani Karmarkar , Guannan Qu