中文
相关论文

相关论文: A New Perspective on Transformers in Online Reinfo…

200 篇论文

The growing complexity and capacity demands for mobile networks necessitate innovative techniques for optimizing resource usage. Meanwhile, recent breakthroughs have brought Reinforcement Learning (RL) into the domain of continuous control…

网络与互联网体系结构 · 计算机科学 2022-10-28 Vegard Edvardsen , Gard Spreemann , Jeriek Van den Abeele

Large transformer models trained on diverse datasets have shown a remarkable ability to learn in-context, achieving high few-shot performance on tasks they were not explicitly trained to solve. In this paper, we study the in-context…

机器学习 · 计算机科学 2023-06-27 Jonathan N. Lee , Annie Xie , Aldo Pacchiano , Yash Chandak , Chelsea Finn , Ofir Nachum , Emma Brunskill

Reinforcement learning (RL) has proved to have a promising role in future intelligent wireless networks. Online RL has been adopted for radio resource management (RRM), taking over traditional schemes. However, due to its reliance on online…

机器学习 · 计算机科学 2025-01-24 Eslam Eldeeb , Hirley Alves

Process control is widely discussed in the manufacturing process, especially for semiconductor manufacturing. Due to unavoidable disturbances in manufacturing, different process controllers are proposed to realize variation reduction. Since…

系统与控制 · 电气工程与系统科学 2021-10-25 Yanrong Li , Juan Du , Wei Jiang

Reinforcement learning is well suited for optimizing policies of recommender systems. Current solutions mostly focus on model-free approaches, which require frequent interactions with the real environment, and thus are expensive in model…

机器学习 · 计算机科学 2020-01-22 Xueying Bai , Jian Guan , Hongning Wang

Recent work has shown that supervised learning alone, without temporal difference (TD) learning, can be remarkably effective for offline RL. When does this hold true, and which algorithmic components are necessary? Through extensive…

机器学习 · 计算机科学 2022-05-12 Scott Emmons , Benjamin Eysenbach , Ilya Kostrikov , Sergey Levine

In the rapidly changing healthcare landscape, the implementation of offline reinforcement learning (RL) in dynamic treatment regimes (DTRs) presents a mix of unprecedented opportunities and challenges. This position paper offers a critical…

机器学习 · 计算机科学 2024-06-05 Zhiyao Luo , Yangchen Pan , Peter Watkinson , Tingting Zhu

Precise robot manipulation is critical for fine-grained applications such as chemical and biological experiments, where even small errors (e.g., reagent spillage) can invalidate an entire task. Existing approaches often rely on…

机器人学 · 计算机科学 2026-02-13 Xiangyu Chen , Chuhao Zhou , Yuxi Liu , Jianfei Yang

Offline reinforcement learning, which learns solely from datasets without environmental interaction, has gained attention. This approach, similar to traditional online deep reinforcement learning, is particularly promising for robot control…

机器人学 · 计算机科学 2025-07-21 Shingo Ayabe , Takuto Otomo , Hiroshi Kera , Kazuhiko Kawamoto

Multirotors play a significant role in diverse field robotics applications but remain highly susceptible to actuator failures, leading to rapid instability and compromised mission reliability. While various fault-tolerant control (FTC)…

机器人学 · 计算机科学 2025-05-14 Dohyun Kim , Jayden Dongwoo Lee , Hyochoong Bang , Jungho Bae

In this article, we aim to provide a literature review of different formulations and approaches to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We begin by discussing our perspective on why RL is a…

机器学习 · 计算机科学 2022-11-15 Khimya Khetarpal , Matthew Riemer , Irina Rish , Doina Precup

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

机器学习 · 计算机科学 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

Reinforcement learning (RL) in the real world necessitates the development of procedures that enable agents to explore without causing harm to themselves or others. The most successful solutions to the problem of safe RL leverage offline…

机器学习 · 计算机科学 2025-01-09 Alexander Quessy , Thomas Richardson , Sebastian East

Offline reinforcement learning has shown great promise in leveraging large pre-collected datasets for policy learning, allowing agents to forgo often-expensive online data collection. However, offline reinforcement learning from visual…

机器学习 · 计算机科学 2023-07-07 Cong Lu , Philip J. Ball , Tim G. J. Rudner , Jack Parker-Holder , Michael A. Osborne , Yee Whye Teh

Continual reinforcement learning (CRL) refers to a naturalistic setting where an agent needs to endlessly evolve, by trial and error, to solve multiple tasks that are presented sequentially. One of the largest obstacles to CRL is that the…

机器学习 · 计算机科学 2025-07-15 Zichen Liu , Guoji Fu , Chao Du , Wee Sun Lee , Min Lin

This paper discusses learning a structured feedback control to obtain sufficient robustness to exogenous inputs for linear dynamic systems with unknown state matrix. The structural constraint on the controller is necessary for many…

系统与控制 · 电气工程与系统科学 2021-02-23 Sayak Mukherjee , Thanh Long Vu

Offline-to-online reinforcement learning (RL) has emerged as a practical paradigm that leverages offline datasets for pretraining and online interactions for fine-tuning. However, its empirical behavior is highly inconsistent: design…

机器学习 · 计算机科学 2026-02-03 Lu Li , Tianwei Ni , Yihao Sun , Pierre-Luc Bacon

Pre-training has been a useful method for learning implicit transferable knowledge and it shows the benefit of offering complementary features across different modalities. Recent work mainly focuses on the modalities such as image and text,…

计算与语言 · 计算机科学 2022-12-09 Ziqi Zhang , Yile Wang , Yue Zhang , Donglin Wang

Reinforcement learning has emerged as a promising methodology for training robot controllers. However, most results have been limited to simulation due to the need for a large number of samples and the lack of automated-yet-safe data…

机器人学 · 计算机科学 2018-03-29 Kendall Lowrey , Svetoslav Kolev , Jeremy Dao , Aravind Rajeswaran , Emanuel Todorov