中文
相关论文

相关论文: On the Complexity of Offline Reinforcement Learnin…

200 篇论文

Existing theoretical studies on offline reinforcement learning (RL) mostly consider a dataset sampled directly from the target task. In practice, however, data often come from several heterogeneous but related sources. Motivated by this…

机器学习 · 统计学 2023-06-16 Chengshuai Shi , Wei Xiong , Cong Shen , Jing Yang

Offline reinforcement learning (RL) is an attractive tool for unmanned aerial vehicle (UAV) systems, where online exploration is costly and raises safety concerns. In terrain-aware UAV relaying, agents may observe high-dimensional inputs…

信号处理 · 电气工程与系统科学 2026-04-02 Joseanne Viana , Viswak R Balaji , Boris Galkin , Lester Ho , Holger Claussen

Offline reinforcement learning (RL) addresses the challenge of expensive and high-risk data exploration inherent in RL by pre-training policies on vast amounts of offline data, enabling direct deployment or fine-tuning in real-world…

机器学习 · 计算机科学 2024-08-13 Thanh Nguyen , Tung M. Luu , Tri Ton , Chang D. Yoo

The field of Offline Reinforcement Learning (RL) aims to derive effective policies from pre-collected datasets without active environment interaction. While traditional offline RL algorithms like Conservative Q-Learning (CQL) and Implicit…

机器学习 · 计算机科学 2025-11-21 Ali Murtaza Caunhye , Asad Jeewa

Currently, reinforcement learning (RL), especially deep RL, has received more and more attention in the research area. However, the security of RL has been an obvious problem due to the attack manners becoming mature. In order to defend…

机器学习 · 计算机科学 2023-10-04 Jiarui Yao , Simon Shaolei Du

Reinforcement learning (RL) has been widely adopted for controlling and optimizing complex engineering systems such as next-generation wireless networks. An important challenge in adopting RL is the need for direct access to the physical…

机器学习 · 计算机科学 2024-11-19 Eslam Eldeeb , Houssem Sifaou , Osvaldo Simeone , Mohammad Shehab , Hirley Alves

We study value adaptation in offline-to-online reinforcement learning under general function approximation. Starting from an imperfect offline pretrained $Q$-function, the learner aims to adapt it to the target environment using only a…

机器学习 · 计算机科学 2026-04-16 Shangzhe Li , Weitong Zhang

Reinforcement learning (RL) with limited samples is common in real-world applications. However, offline RL performance under this constraint is often suboptimal. We consider an alternative approach to dealing with limited samples by…

机器学习 · 计算机科学 2025-11-14 Outongyi Lv , Yewei Yuan , Nana Liu

We study reinforcement learning in infinite-horizon discounted Markov decision processes with continuous state spaces, where data are generated online from a single trajectory under a Markovian behavior policy. To avoid maintaining an…

机器学习 · 计算机科学 2026-03-05 Shengbo Wang

A key problem in off-policy Reinforcement Learning (RL) is the mismatch, or distribution shift, between the dataset and the distribution over states and actions visited by the learned policy. This problem is exacerbated in the fully offline…

机器学习 · 计算机科学 2023-11-28 Melrose Roderick , Gaurav Manek , Felix Berkenkamp , J. Zico Kolter

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

机器学习 · 计算机科学 2021-02-12 Mengjiao Yang , Ofir Nachum

The rapid growth of heterogeneous and massive wireless connectivity in 6G networks demands intelligent solutions to ensure scalability, reliability, privacy, ultra-low latency, and effective control. Although artificial intelligence (AI)…

机器学习 · 计算机科学 2025-04-08 Eslam Eldeeb , Hirley Alves

Inverse Reinforcement Learning (IRL) -- the problem of learning reward functions from demonstrations of an \emph{expert policy} -- plays a critical role in developing intelligent systems. While widely used in applications, theoretical…

机器学习 · 统计学 2024-02-13 Lei Zhao , Mengdi Wang , Yu Bai

We present the first theoretical guarantees for differentially private online reinforcement learning (RL) with general function approximation, extending beyond prior work restricted to tabular and linear settings. Our approach combines a…

机器学习 · 计算机科学 2026-05-11 Yi He , Xingyu Zhou

Offline Reinforcement Learning (RL) has emerged as a powerful alternative to imitation learning for behavior modeling in various domains, particularly in complex navigation tasks. An existing challenge with Offline RL is the signal-to-noise…

机器学习 · 计算机科学 2024-11-13 Alexi Canesse , Mathieu Petitbois , Ludovic Denoyer , Sylvain Lamprier , Rémy Portelas

The field of quickest change detection (QCD) concerns design and analysis of algorithms to estimate in real time the time at which an important event takes place, and identify properties of the post-change behavior. It is shown in this…

最优化与控制 · 数学 2024-09-16 Austin Cooper , Sean Meyn

Reinforcement Learning (RL) has opened up new opportunities to enhance existing smart systems that generally include a complex decision-making process. However, modern RL algorithms, e.g., Deep Q-Networks (DQN), are based on deep neural…

机器学习 · 计算机科学 2023-06-22 Yang Ni , Danny Abraham , Mariam Issa , Yeseong Kim , Pietro Mercati , Mohsen Imani

Establishing robust policies is essential to counter attacks or disturbances affecting deep reinforcement learning (DRL) agents. Recent studies explore state-adversarial robustness and suggest the potential lack of an optimal robust policy…

机器学习 · 计算机科学 2024-06-24 Haoran Li , Zicheng Zhang , Wang Luo , Congying Han , Yudong Hu , Tiande Guo , Shichen Liao

Offline reinforcement learning promises policy improvement from logged interaction data alone, yet state-of-the-art algorithms remain vulnerable to value over-estimation and to violations of domain knowledge such as monotonicity or…

系统与控制 · 电气工程与系统科学 2025-06-18 Ali Baheri

Offline reinforcement learning, which seeks to utilize offline/historical data to optimize sequential decision-making strategies, has gained surging prominence in recent studies. Due to the advantage that appropriate function approximators…

机器学习 · 计算机科学 2022-03-14 Ming Yin , Yaqi Duan , Mengdi Wang , Yu-Xiang Wang