中文
相关论文

相关论文: Distilling Reinforcement Learning Algorithms for I…

200 篇论文

Large language models are increasingly post-trained with reinforcement learning in verifiable domains such as code and math. Yet, current methods for reinforcement learning with verifiable rewards (RLVR) learn only from a scalar outcome…

Traditionally, reinforcement learning (RL) agents learn to solve new tasks by updating their neural network parameters through interactions with the task environment. However, recent works demonstrate that some RL agents, after certain…

机器学习 · 计算机科学 2025-02-26 Jiuqi Wang , Ethan Blaser , Hadi Daneshmand , Shangtong Zhang

Recent developments in large pre-trained language models have enabled unprecedented performance on a variety of downstream tasks. Achieving best performance with these models often leverages in-context learning, where a model performs a…

计算与语言 · 计算机科学 2024-04-17 Alexander Scarlatos , Andrew Lan

Diffusion models have shown promising capabilities in trajectory generation for planning in offline reinforcement learning (RL). However, conventional diffusion-based planning methods often fail to account for the fact that generating…

人工智能 · 计算机科学 2026-02-25 Hanping Zhang , Yuhong Guo

Reinforcement learning (RL) algorithms find applications in inventory control, recommender systems, vehicular traffic management, cloud computing and robotics. The real-world complications of many tasks arising in these domains makes them…

机器学习 · 计算机科学 2021-06-03 Sindhu Padakandla

A key challenge of continual reinforcement learning (CRL) in dynamic environments is to promptly adapt the RL agent's behavior as the environment changes over its lifetime, while minimizing the catastrophic forgetting of the learned…

机器学习 · 计算机科学 2023-05-25 Tiantian Zhang , Zichuan Lin , Yuxing Wang , Deheng Ye , Qiang Fu , Wei Yang , Xueqian Wang , Bin Liang , Bo Yuan , Xiu Li

Offline reinforcement learning often requires a quality dataset that we can train a policy on. However, in many situations, it is not possible to get such a dataset, nor is it easy to train a policy to perform well in the actual environment…

机器学习 · 计算机科学 2025-11-04 Jonathan Light , Yuanzhe Liu , Ziniu Hu

Most reinforcement learning (RL) methods only focus on learning a single task from scratch and are not able to use prior knowledge to learn other tasks more effectively. Context-based meta RL techniques are recently proposed as a possible…

机器学习 · 计算机科学 2022-08-01 Xu Han , Feng Wu

Robotic control policies learned from human demonstrations have achieved impressive results in many real-world applications. However, in scenarios where initial performance is not satisfactory, as is often the case in novel open-world…

In-context learning (ICL) allows large language models (LLMs) to solve novel tasks without weight updates. Despite its empirical success, the mechanism behind ICL remains poorly understood, limiting our ability to interpret, improve, and…

机器学习 · 计算机科学 2025-06-16 Chengye Li , Haiyun Liu , Yuanxi Li

Programmatic reinforcement learning (PRL) offers an interpretable alternative to deep reinforcement learning by representing policies as human-readable and -editable programs. While gradient-based methods have been developed to optimize…

机器学习 · 计算机科学 2026-05-19 Chengpeng Hu , Yingqian Zhang , Hendrik Baier

In-context reinforcement learning (ICRL) leverages the in-context learning capabilities of transformer models (TMs) to efficiently generalize to unseen sequential decision-making tasks without parameter updates. However, existing ICRL…

机器学习 · 计算机科学 2026-02-10 Juncheng Dong , Bowen He , Moyang Guo , Ethan X. Fang , Zhuoran Yang , Vahid Tarokh

As humans, our goals and our environment are persistently changing throughout our lifetime based on our experiences, actions, and internal and external drives. In contrast, typical reinforcement learning problem set-ups consider decision…

机器学习 · 计算机科学 2020-06-19 Annie Xie , James Harrison , Chelsea Finn

In-context learning (ICL), the remarkable ability to solve a task from only input exemplars, is often assumed to be a unique hallmark of Transformer models. By examining commonly employed synthetic ICL tasks, we demonstrate that multi-layer…

机器学习 · 计算机科学 2025-02-26 William L. Tong , Cengiz Pehlevan

In-context learning (ICL) allows Transformers to adapt to novel tasks without weight updates, yet the underlying algorithms remain poorly understood. We adopt a statistical decision-theoretic perspective by investigating simple binary…

机器学习 · 计算机科学 2026-03-13 Faris Chaudhry , Siddhant Gadkari

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

机器学习 · 计算机科学 2025-05-16 Jonathan Clifford Balloch

In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge…

机器人学 · 计算机科学 2020-08-07 Lei He , Nabil Aouf , James F. Whidborne , Bifeng Song

Automated planning algorithms require an action model specifying the preconditions and effects of each action, but obtaining such a model is often hard. Learning action models from observations is feasible, but existing algorithms for…

人工智能 · 计算机科学 2026-04-13 Yarin Benyamin , Argaman Mordoch , Shahaf S. Shperberg , Roni Stern

This paper demonstrates the application of reinforcement learning (RL) to process synthesis by presenting Distillation Gym, a set of RL environments in which an RL agent is tasked with designing a distillation train, given a user defined…

机器学习 · 计算机科学 2020-09-29 Laurence Illing Midgley

The transfer of knowledge from one policy to another is an important tool in Deep Reinforcement Learning. This process, referred to as distillation, has been used to great success, for example, by enhancing the optimisation of agents,…