English
Related papers

Related papers: Context Representation via Action-Free Transformer…

200 papers

Constraint-based control approaches offer a flexible way to specify robotic manipulation tasks and execute them on robots with many degrees of freedom. However, the specification of task constraints and their associated priorities usually…

Robotics · Computer Science 2021-04-14 Dennis Mronga , Frank Kirchner

Human-robot cooperation is essential in environments such as warehouses and retail stores, where workers frequently handle deformable objects like paper, bags, and fabrics. Coordinating robotic actions with human assistance remains…

Robotics · Computer Science 2025-11-06 Rewida Ali , Cristian C. Beltran-Hernandez , Weiwei Wan , Kensuke Harada

Reinforcement learning (RL) can be formulated as a sequence modeling problem, where models predict future actions based on historical state-action-reward sequences. Current approaches typically require long trajectory sequences to model the…

Machine Learning · Computer Science 2024-12-23 Hemant Kumawat , Saibal Mukhopadhyay

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

Recent state-of-the-art artificial agents lack the ability to adapt rapidly to new tasks, as they are trained exclusively for specific objectives and require massive amounts of interaction to learn new skills. Meta-reinforcement learning…

Machine Learning · Computer Science 2022-03-23 Zhenshan Bing , Lukas Knak , Fabrice Oliver Robin , Kai Huang , Alois Knoll

What if artificial intelligence could not only solve problems for which it was trained but also learn to teach itself to solve new problems (i.e., meta-learn)? In this study, we demonstrate that a pre-trained transformer fine-tuned with…

Machine Learning · Computer Science 2025-01-27 Micah Rentschler , Jesse Roberts

In-context learning is a promising approach for offline reinforcement learning (RL) to handle online tasks, which can be achieved by providing task prompts. Recent works demonstrated that in-context RL could emerge with self-improvement in…

Machine Learning · Computer Science 2024-06-03 Sili Huang , Jifeng Hu , Hechang Chen , Lichao Sun , Bo Yang

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen

Reinforcement learning (RL) agents aim at learning by interacting with an environment, and are not designed for representing or reasoning with declarative knowledge. Knowledge representation and reasoning (KRR) paradigms are strong in…

Artificial Intelligence · Computer Science 2018-11-26 Keting Lu , Shiqi Zhang , Peter Stone , Xiaoping Chen

We investigate the ability of transformers to perform in-context reinforcement learning (ICRL), where a model must infer and execute learning algorithms from trajectory data without parameter updates. We show that a linear self-attention…

Machine Learning · Statistics 2026-05-08 Haodong Liang , Lifeng Lai

This paper introduces Fast Linearized Adaptive Policy (FLAP), a new meta-reinforcement learning (meta-RL) method that is able to extrapolate well to out-of-distribution tasks without the need to reuse data from training, and adapt almost…

Machine Learning · Computer Science 2021-01-14 Matt Peng , Banghua Zhu , Jiantao Jiao

Traditionally, reinforcement learning methods predict the next action based on the current state. However, in many situations, directly applying actions to control systems or robots is dangerous and may lead to unexpected behaviors because…

Robotics · Computer Science 2020-11-03 Nan Lin , Yuxuan Li , Yujun Zhu , Ruolin Wang , Xiayu Zhang , Jianmin Ji , Keke Tang , Xiaoping Chen , Xinming Zhang

Reinforcement Learning (RL) faces significant challenges in adaptive healthcare interventions, such as dementia care, where data is scarce, decisions require interpretability, and underlying patient-state dynamic are complex and causal in…

Robotics · Computer Science 2025-12-02 Wenzheng Zhao , Ran Zhang , Ruth Palan Lopez , Shu-Fen Wung , Fengpei Yuan

In this work we investigate a specific transfer learning approach for deep reinforcement learning in the context where the internal dynamics between two tasks are the same but the visual representations differ. We learn a low-dimensional…

Machine Learning · Computer Science 2021-11-24 Geoffrey van Driessel , Vincent Francois-Lavet

Transformers have demonstrated exceptional in-context learning (ICL) capabilities, enabling applications across natural language processing, computer vision, and sequential decision-making. In reinforcement learning, ICL reframes learning…

Machine Learning · Computer Science 2025-11-14 Oliver Dippel , Alexei Lisitsa , Bei Peng

Meta-Reinforcement Learning (Meta-RL) enables fast adaptation to new testing tasks. Despite recent advancements, it is still challenging to learn performant policies across multiple complex and high-dimensional tasks. To address this, we…

Machine Learning · Computer Science 2024-12-17 Minjae Cho , Chuangchuang Sun

Reinforcement learning (RL) can in principle let robots automatically adapt to new tasks, but current RL methods require a large number of trials to accomplish this. In this paper, we tackle rapid adaptation to new tasks through the…

Meta-learning enables rapid generalization to new tasks by learning knowledge from various tasks. It is intuitively assumed that as the training progresses, a model will acquire richer knowledge, leading to better generalization…

Machine Learning · Computer Science 2024-05-30 Jingyao Wang , Yi Ren , Zeen Song , Jianqi Zhang , Changwen Zheng , Wenwen Qiang

Safe reinforcement learning (RL) trains a constraint satisfaction policy by interacting with the environment. We aim to tackle a more challenging problem: learning a safe policy from an offline dataset. We study the offline safe RL problem…

Machine Learning · Computer Science 2023-06-22 Zuxin Liu , Zijian Guo , Yihang Yao , Zhepeng Cen , Wenhao Yu , Tingnan Zhang , Ding Zhao

Meta-Reinforcement Learning (Meta-RL) aims to acquire meta-knowledge for quick adaptation to diverse tasks. However, applying these policies in real-world environments presents a significant challenge in balancing rapid adaptability with…

Machine Learning · Computer Science 2024-06-21 Karam Daaboul , Florian Kuhm , Tim Joseph , J. Marius Zoellner