中文
相关论文

相关论文: Importance of Empirical Sample Complexity Analysis…

200 篇论文

Reinforcement learning (RL) is an innovative approach to financial decision making, offering specialized solutions to complex investment problems where traditional methods fail. This review analyzes 167 articles from 2017--2025, focusing on…

计算金融 · 定量金融 2025-12-12 Mohammad Rezoanul Hoque , Md Meftahul Ferdaus , M. Kabir Hassan

Dynamic radio resource management (RRM) in wireless networks presents significant challenges, particularly in the context of Radio Access Network (RAN) slicing. This technology, crucial for catering to varying user requirements, often…

信息论 · 计算机科学 2023-12-19 Kun Yang , Shu-ping Yeh , Menglei Zhang , Jerry Sydir , Jing Yang , Cong Shen

We study the problem of representation transfer in offline Reinforcement Learning (RL), where a learner has access to episodic data from a number of source tasks collected a priori, and aims to learn a shared representation to be used in…

机器学习 · 计算机科学 2024-02-21 Avinandan Bose , Simon Shaolei Du , Maryam Fazel

Offline reinforcement learning (RL) addresses the challenge of expensive and high-risk data exploration inherent in RL by pre-training policies on vast amounts of offline data, enabling direct deployment or fine-tuning in real-world…

机器学习 · 计算机科学 2024-08-13 Thanh Nguyen , Tung M. Luu , Tri Ton , Chang D. Yoo

The offline reinforcement learning (RL) problem aims to learn an optimal policy from historical data collected by one or more behavioural policies (experts) by interacting with an environment. However, the individual experts may be…

密码学与安全 · 计算机科学 2025-11-25 Navodita Sharma , Vishnu Vinod , Abhradeep Thakurta , Alekh Agarwal , Borja Balle , Christoph Dann , Aravindan Raghuveer

Despite recent progress in training long-chain-of-thought reasoning models via scaling reinforcement learning (RL), its underlying training dynamics remain poorly understood, and several counterintuitive behaviors persist. This work focuses…

机器学习 · 计算机科学 2025-11-11 Yongyu Mu , Jiali Zeng , Bei Li , Xinyan Guan , Fandong Meng , Jie Zhou , Tong Xiao , Jingbo Zhu

Recent theoretical work studies sample-efficient reinforcement learning (RL) extensively in two settings: learning interactively in the environment (online RL), or learning from an offline dataset (offline RL). However, existing algorithms…

机器学习 · 计算机科学 2022-02-14 Tengyang Xie , Nan Jiang , Huan Wang , Caiming Xiong , Yu Bai

Distributionally robust offline reinforcement learning (RL), which seeks robust policy training against environment perturbation by modeling dynamics uncertainty, calls for function approximations when facing large state-action spaces.…

机器学习 · 计算机科学 2025-11-03 Zhishuai Liu , Pan Xu

Reinforcement learning (RL) provides an appealing formalism for learning control policies from experience. However, the classic active formulation of RL necessitates a lengthy active exploration process for each behavior, making it…

机器学习 · 计算机科学 2021-04-27 Ashvin Nair , Abhishek Gupta , Murtaza Dalal , Sergey Levine

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

人工智能 · 计算机科学 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

Offline-to-online reinforcement learning (RL), a framework that trains a policy with offline RL and then further fine-tunes it with online RL, has been considered a promising recipe for data-driven decision-making. While sensible, this…

机器学习 · 计算机科学 2024-08-28 Junsu Kim , Seohong Park , Sergey Levine

Reinforcement learning serves as a potent tool for modeling dynamic user interests within recommender systems, garnering increasing research attention of late. However, a significant drawback persists: its poor data efficiency, stemming…

信息检索 · 计算机科学 2023-08-23 Xiaocong Chen , Siyu Wang , Julian McAuley , Dietmar Jannach , Lina Yao

Offline-to-online reinforcement learning (RL) leverages both pre-trained offline policies and online policies trained for downstream tasks, aiming to improve data efficiency and accelerate performance enhancement. An existing approach,…

机器学习 · 计算机科学 2024-11-01 JaeYoon Kim , Junyu Xuan , Christy Liang , Farookh Hussain

Offline-to-online reinforcement learning (O2O RL) aims to obtain a continually improving policy as it interacts with the environment, while ensuring the initial policy behaviour is satisficing. This satisficing behaviour is necessary for…

机器人学 · 计算机科学 2025-01-24 Bryan Chan , Anson Leung , James Bergstra

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

机器人学 · 计算机科学 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter

We consider the problem of sequential recommendation, where the current recommendation is made based on past interactions. This recommendation task requires efficient processing of the sequential data and aims to provide recommendations…

信息检索 · 计算机科学 2023-07-28 Xumei Xi , Yuke Zhao , Quan Liu , Liwen Ouyang , Yang Wu

Recent work has shown that supervised learning alone, without temporal difference (TD) learning, can be remarkably effective for offline RL. When does this hold true, and which algorithmic components are necessary? Through extensive…

机器学习 · 计算机科学 2022-05-12 Scott Emmons , Benjamin Eysenbach , Ilya Kostrikov , Sergey Levine

We consider reinforcement learning (RL) methods in offline domains without additional online data collection, such as mobile health applications. Most of existing policy optimization algorithms in the computer science literature are…

机器学习 · 统计学 2022-07-28 Chengchun Shi , Shikai Luo , Yuan Le , Hongtu Zhu , Rui Song

The offline reinforcement learning (RL) setting (also known as full batch RL), where a policy is learned from a static dataset, is compelling as progress enables RL methods to take advantage of large, previously-collected datasets, much…

机器学习 · 计算机科学 2021-02-09 Justin Fu , Aviral Kumar , Ofir Nachum , George Tucker , Sergey Levine

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

机器学习 · 计算机科学 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider