English
Related papers

Related papers: Learning Long-Context Diffusion Policies via Past-…

200 papers

Recurrent Neural Networks can be trained to produce sequences of tokens given some input, as exemplified by recent results in machine translation and image captioning. The current approach to training them consists of maximizing the…

Machine Learning · Computer Science 2015-09-24 Samy Bengio , Oriol Vinyals , Navdeep Jaitly , Noam Shazeer

Imitation learning is a widely used policy learning method that enables intelligent agents to acquire complex skills from expert demonstrations. The input to the imitation learning algorithm is usually composed of both the current…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Chia-Chi Chuang , Donglin Yang , Chuan Wen , Yang Gao

In many real-world settings, agents must learn from an offline dataset gathered by some prior behavior policy. Such a setting naturally leads to distribution shift between the behavior policy and the target policy being trained - requiring…

Machine Learning · Computer Science 2024-04-10 Matthew Thomas Jackson , Michael Tryfan Matthews , Cong Lu , Benjamin Ellis , Shimon Whiteson , Jakob Foerster

Decision-making in robotics using denoising diffusion processes has increasingly become a hot research topic, but end-to-end policies perform poorly in tasks with rich contact and have limited controllability. This paper proposes…

Robotics · Computer Science 2024-11-21 Dexin Wang , Chunsheng Liu , Faliang Chang , Yichen Xu

Humans can accomplish complex contact-rich tasks using vision and touch, with highly reactive capabilities such as fast response to external changes and adaptive control of contact forces; however, this remains challenging for robots.…

Robotics · Computer Science 2025-04-24 Han Xue , Jieji Ren , Wendi Chen , Gu Zhang , Yuan Fang , Guoying Gu , Huazhe Xu , Cewu Lu

Optimizing training performance in large language models (LLMs) remains an essential challenge, particularly in improving model performance while maintaining computational costs. This work challenges the conventional approach of training…

Computation and Language · Computer Science 2025-11-04 Chun-Hao Yang , Bo-Han Feng , Tzu-Yuan Lai , Yan Yu Chen , Yin-Kai Dean Huang , Shou-De Lin

Safe and successful deployment of robots requires not only the ability to generate complex plans but also the capacity to frequently replan and correct execution errors. This paper addresses the challenge of long-horizon trajectory planning…

Robotics · Computer Science 2024-10-04 Zeyu Feng , Hao Luan , Kevin Yuchen Ma , Harold Soh

Deep reinforcement learning (deep RL) excels in various domains but lacks generalizability and interpretability. On the other hand, programmatic RL methods (Trivedi et al., 2021; Liu et al., 2023) reformulate RL tasks as synthesizing…

Machine Learning · Computer Science 2024-02-12 Yu-An Lin , Chen-Tao Lee , Guan-Ting Liu , Pu-Jen Cheng , Shao-Hua Sun

Imitation Learning offers a promising approach to learn directly from data without requiring explicit models, simulations, or detailed task definitions. During inference, actions are sampled from the learned distribution and executed on the…

Robotics · Computer Science 2025-10-28 Amirreza Razmjoo , Sylvain Calinon , Michael Gienger , Fan Zhang

In recent years, the robotics community has made substantial progress in robotic manipulation using deep reinforcement learning (RL). Effectively learning of long-horizon tasks remains a challenging topic. Typical RL-based methods…

Robotics · Computer Science 2021-05-13 Zhihao Li , Zhenglong Sun , Jionglong SU , Jiaming Zhang

On-policy deep reinforcement learning algorithms have low data utilization and require significant experience for policy improvement. This paper proposes a proximal policy optimization algorithm with prioritized trajectory replay (PTR-PPO)…

Machine Learning · Computer Science 2021-12-09 Xingxing Liang , Yang Ma , Yanghe Feng , Zhong Liu

Reinforcement learning (RL) agents performing complex tasks must be able to remember observations and actions across sizable time intervals. This is especially true during the initial learning stages, when exploratory behaviour can increase…

Machine Learning · Computer Science 2018-05-15 Thomas Stepleton , Razvan Pascanu , Will Dabney , Siddhant M. Jayakumar , Hubert Soyer , Remi Munos

Position embeddings, encoding the positional relationships among tokens in text sequences, make great contributions to modeling local context features in Transformer-based pre-trained language models. However, in Extractive Question…

Computation and Language · Computer Science 2023-11-21 Mingxu Tao , Yansong Feng , Dongyan Zhao

Large language models (LLMs) increasingly operate in settings that require reliable long-context understanding, such as retrieval-augmented generation and multi-document reasoning. A common strategy is to fine-tune pretrained short-context…

Computation and Language · Computer Science 2026-04-17 Zichong Li , Chen Liang , Liliang Ren , Tuo Zhao , Yelong Shen , Weizhu Chen

Prompt-tuning has emerged as a promising method for adapting pre-trained models to downstream tasks or aligning with human preferences. Prompt learning is widely used in NLP but has limited applicability to RL due to the complex physical…

Machine Learning · Computer Science 2023-05-17 Shengchao Hu , Li Shen , Ya Zhang , Dacheng Tao

Training an agent to achieve particular goals or perform desired behaviors is often accomplished through reinforcement learning, especially in the absence of expert demonstrations. However, supporting novel goals or behaviors through…

Machine Learning · Computer Science 2024-11-01 Calvin Luo , Mandy He , Zilai Zeng , Chen Sun

Data-efficient learning algorithms are essential in many practical applications where data collection is expensive, e.g., in robotics due to the wear and tear. To address this problem, meta-learning algorithms use prior experience about…

Machine Learning · Computer Science 2020-10-26 Jean Kaddour , Steindór Sæmundsson , Marc Peter Deisenroth

Simultaneously grasping and delivering multiple objects can significantly enhance robotic work efficiency and has been a key research focus for decades. The primary challenge lies in determining how to push objects, group them, and execute…

Robotics · Computer Science 2025-08-04 Takahiro Yonemaru , Weiwei Wan , Tatsuki Nishimura , Kensuke Harada

Diffusion Policy (DP) excels in embodied control but suffers from high inference latency and computational cost due to multiple iterative denoising steps. The temporal complexity of embodied tasks demands a dynamic and adaptable computation…

Machine Learning · Computer Science 2025-12-19 Ye Li , Jiahe Feng , Yuan Meng , Kangye Ji , Chen Tang , Xinwan Wen , Shutao Xia , Zhi Wang , Wenwu Zhu

Robot control policies for temporally extended and sequenced tasks are often characterized by discontinuous switches between different local dynamics. These change-points are often exploited in hierarchical motion planning to build…

Robotics · Computer Science 2020-02-18 Daniel Angelov , Yordan Hristov , Michael Burke , Subramanian Ramamoorthy