中文
相关论文

相关论文: Look Beneath the Surface: Exploiting Fundamental S…

200 篇论文

Most Reinforcement Learning (RL) methods are traditionally studied in an active learning setting, where agents directly interact with their environments, observe action outcomes, and learn through trial and error. However, allowing…

人工智能 · 计算机科学 2023-10-16 Maryam Zare , Parham M. Kebria , Abbas Khosravi

The field of Offline Reinforcement Learning (RL) aims to derive effective policies from pre-collected datasets without active environment interaction. While traditional offline RL algorithms like Conservative Q-Learning (CQL) and Implicit…

机器学习 · 计算机科学 2025-11-21 Ali Murtaza Caunhye , Asad Jeewa

The objective of offline RL is to learn optimal policies when a fixed exploratory demonstrations data-set is available and sampling additional observations is impossible (typically if this operation is either costly or rises ethical…

机器学习 · 计算机科学 2021-06-10 Firas Jarboui , Vianney Perchet

Deep reinforcement learning (RL) is a data-driven method capable of discovering complex control strategies for high-dimensional systems, making it promising for flow control applications. In particular, the present work is motivated by the…

机器学习 · 计算机科学 2022-11-23 Kevin Zeng , Alec J. Linot , Michael D. Graham

The offline reinforcement learning (RL) setting (also known as full batch RL), where a policy is learned from a static dataset, is compelling as progress enables RL methods to take advantage of large, previously-collected datasets, much…

机器学习 · 计算机科学 2021-02-09 Justin Fu , Aviral Kumar , Ofir Nachum , George Tucker , Sergey Levine

In this paper, the inverse reinforcement learning (IRL) problem is addressed to reconstruct the unknown cost function underlying an observed optimal policy in a model-free manner, whose online adaptation with completely off-policy system…

最优化与控制 · 数学 2025-11-20 Yibei Li , Yuexin Cao , Zhixin Liu , Lihua Xie

Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due…

机器学习 · 计算机科学 2024-02-19 Linh Le Pham Van , Hung The Tran , Sunil Gupta

A long-standing goal in AI is to develop agents capable of solving diverse tasks across a range of environments, including those never seen during training. Two dominant paradigms address this challenge: (i) reinforcement learning (RL),…

机器学习 · 计算机科学 2025-10-30 Vlad Sobal , Wancong Zhang , Kyunghyun Cho , Randall Balestriero , Tim G. J. Rudner , Yann LeCun

In reinforcement learning (RL), there are two major settings for interacting with the environment: online and offline. Online methods explore the environment at significant time cost, and offline methods efficiently obtain reward signals by…

机器学习 · 计算机科学 2023-06-19 Changyu Chen , Xiting Wang , Yiqiao Jin , Victor Ye Dong , Li Dong , Jie Cao , Yi Liu , Rui Yan

With the widespread adoption of deep learning, reinforcement learning (RL) has experienced a dramatic increase in popularity, scaling to previously intractable problems, such as playing complex games from pixel observations, sustaining…

机器学习 · 计算机科学 2023-04-20 Rafael Figueiredo Prudencio , Marcos R. O. A. Maximo , Esther Luna Colombini

Model-based reinforcement learning (RL), which learns an environment model from the offline dataset and generates more out-of-distribution model data, has become an effective approach to the problem of distribution shift in offline RL. Due…

Offline Reinforcement Learning (ORL) is a promising approach to reduce the high sample complexity of traditional Reinforcement Learning (RL) by eliminating the need for continuous environmental interactions. ORL exploits a dataset of…

人工智能 · 计算机科学 2024-07-15 Girolamo Macaluso , Alessandro Sestini , Andrew D. Bagdanov

Offline Reinforcement Learning (RL) has shown promising results in learning a task-specific policy from a fixed dataset. However, successful offline RL often relies heavily on the coverage and quality of the given dataset. In scenarios…

机器学习 · 计算机科学 2024-05-01 Chenjia Bai , Lingxiao Wang , Jianye Hao , Zhuoran Yang , Bin Zhao , Zhen Wang , Xuelong Li

Training autonomous agents with sparse rewards is a long-standing problem in online reinforcement learning (RL), due to low data efficiency. Prior work overcomes this challenge by extracting useful knowledge from offline data, often…

机器学习 · 计算机科学 2024-06-07 Qianlan Yang , Yu-Xiong Wang

In this work, we study model-based reinforcement learning (RL) in unknown stabilizable linear dynamical systems. When learning a dynamical system, one needs to stabilize the unknown dynamics in order to avoid system blow-ups. We propose an…

机器学习 · 计算机科学 2022-06-06 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

This article presents a digital twin (DT)-enhanced reinforcement learning (RL) framework aimed at optimizing performance and reliability in network resource management, since the traditional RL methods face several unified challenges when…

系统与控制 · 电气工程与系统科学 2024-06-18 Nan Cheng , Xiucheng Wang , Zan Li , Zhisheng Yin , Tom Luan , Xuemin Shen

Offline-to-online reinforcement learning (RL) has emerged as a practical paradigm that leverages offline datasets for pretraining and online interactions for fine-tuning. However, its empirical behavior is highly inconsistent: design…

机器学习 · 计算机科学 2026-02-03 Lu Li , Tianwei Ni , Yihao Sun , Pierre-Luc Bacon

Offline Safe Reinforcement Learning (RL) seeks to address safety constraints by learning from static datasets and restricting exploration. However, these approaches heavily rely on the dataset and struggle to generalize to unseen scenarios…

机器人学 · 计算机科学 2025-03-04 Chenyang Cao , Yucheng Xin , Silang Wu , Longxiang He , Zichen Yan , Junbo Tan , Xueqian Wang

Inverse Reinforcement Learning (IRL) is a powerful framework for learning complex behaviors from expert demonstrations. However, it traditionally requires repeatedly solving a computationally expensive reinforcement learning (RL) problem in…

机器学习 · 计算机科学 2024-02-09 David Wu , Gokul Swamy , J. Andrew Bagnell , Zhiwei Steven Wu , Sanjiban Choudhury

As a paradigm for sequential decision making in unknown environments, reinforcement learning (RL) has received a flurry of attention in recent years. However, the explosion of model complexity in emerging applications and the presence of…

机器学习 · 统计学 2025-07-22 Yuejie Chi , Yuxin Chen , Yuting Wei