English
Related papers

Related papers: Trace-Focused Diffusion Policy for Multi-Modal Act…

200 papers

Robotic manipulation requires understanding both the 3D spatial structure of the environment and its temporal evolution, yet most existing policies overlook one or both. They typically rely on 2D visual observations and backbones pretrained…

Recent work has demonstrated the potential of diffusion models in robot bimanual skill learning. However, existing methods ignore the learning of posture-dependent task features, which are crucial for adapting dual-arm configurations to…

Robotics · Computer Science 2025-10-28 Zhuo Li , Junjia Liu , Dianxi Li , Tao Teng , Miao Li , Sylvain Calinon , Darwin Caldwell , Fei Chen

This work introduces the Multimodal Diffusion Transformer (MDT), a novel diffusion policy framework, that excels at learning versatile behavior from multimodal goal specifications with few language annotations. MDT leverages a…

Robotics · Computer Science 2024-07-09 Moritz Reuss , Ömer Erdinç Yağmurlu , Fabian Wenzel , Rudolf Lioutikov

Diffusion-based policies have shown impressive performance in robotic manipulation tasks while struggling with out-of-domain distributions. Recent efforts attempted to enhance generalization by improving the visual feature encoding for…

Robotics · Computer Science 2025-03-21 Shijie Wu , Yihang Zhu , Yunao Huang , Kaizhen Zhu , Jiayuan Gu , Jingyi Yu , Ye Shi , Jingya Wang

Learning long-horizon robotic manipulation requires jointly achieving expressive behavior modeling, real-time inference, and stable execution, which remains challenging for existing generative policies. Diffusion-based approaches offer…

Robotics · Computer Science 2026-05-19 Wu Songwei , Jiang Zhiduo , Sun Wandong , Xie Guanghu , Zhao Rui , Liu Hong , Liu Yang

Diffusion Policy (DP) has attracted significant attention as an effective method for policy representation due to its capacity to model multi-distribution dynamics. However, current DPs are often based on a single visual modality (e.g., RGB…

Robotics · Computer Science 2025-03-18 Jiahang Cao , Qiang Zhang , Hanzhong Guo , Jiaxu Wang , Hao Cheng , Renjing Xu

Decision-making in robotics using denoising diffusion processes has increasingly become a hot research topic, but end-to-end policies perform poorly in tasks with rich contact and have limited controllability. This paper proposes…

Robotics · Computer Science 2024-11-21 Dexin Wang , Chunsheng Liu , Faliang Chang , Yichen Xu

Diffusion policies (DP) have recently shown great promise for generating actions in robotic manipulation. However, existing approaches often rely on global instructions to produce short-term control signals, which can result in misalignment…

Robotics · Computer Science 2026-01-06 Zhihao Gu , Ming Yang , Difan Zou , Dong Xu

Given a dataset of expert trajectories, standard imitation learning approaches typically learn a direct mapping from observations (e.g., RGB images) to actions. However, such methods often overlook the rich interplay between different…

Robotics · Computer Science 2026-04-14 Zixuan Huang , Huaidian Hou , Dmitry Berenson

Learning robust visuomotor policies that generalize across diverse objects and interaction dynamics remains a central challenge in robotic manipulation. Most existing approaches rely on direct observation-to-action mappings or compress…

Robotics · Computer Science 2025-09-24 Sangjun Noh , Dongwoo Nam , Kangmin Kim , Geonhyup Lee , Yeonguk Yu , Raeyoung Kang , Kyoobin Lee

This paper introduces Hierarchical Diffusion Policy (HDP), a hierarchical agent for multi-task robotic manipulation. HDP factorises a manipulation policy into a hierarchical structure: a high-level task-planning agent which predicts a…

Robotics · Computer Science 2024-03-07 Xiao Ma , Sumit Patidar , Iain Haughton , Stephen James

Recently, diffusion policy has shown impressive results in handling multi-modal tasks in robotic manipulation. However, it has fundamental limitations in out-of-distribution failures that persist due to compounding errors and its limited…

Robotics · Computer Science 2025-03-25 Sung-Wook Lee , Xuhui Kang , Yen-Ling Kuo

This paper introduces Diffusion Policy, a new way of generating robot behavior by representing a robot's visuomotor policy as a conditional denoising diffusion process. We benchmark Diffusion Policy across 12 different tasks from 4…

Robotics · Computer Science 2024-03-15 Cheng Chi , Zhenjia Xu , Siyuan Feng , Eric Cousineau , Yilun Du , Benjamin Burchfiel , Russ Tedrake , Shuran Song

Visuomotor policy learning has witnessed substantial progress in robotic manipulation, with recent approaches predominantly relying on generative models to model the action distribution. However, these methods often overlook the critical…

Robotics · Computer Science 2025-06-18 Yiyang Lu , Yufeng Tian , Zhecheng Yuan , Xianbang Wang , Pu Hua , Zhengrong Xue , Huazhe Xu

Diffusion models exhibit impressive scalability in robotic task learning, yet they struggle to adapt to novel, highly dynamic environments. This limitation primarily stems from their constrained replanning ability: they either operate at a…

Robotics · Computer Science 2025-07-16 Xi Ye , Rui Heng Yang , Jun Jin , Yinchuan Li , Amir Rasouli

Visuomotor imitation learning policies enable robots to efficiently acquire manipulation skills from visual demonstrations. However, as scene complexity and visual distractions increase, policies that perform well in simple settings often…

Artificial Intelligence · Computer Science 2025-11-11 Yuhang Dong , Haizhou Ge , Yupei Zeng , Jiangning Zhang , Beiwen Tian , Hongrui Zhu , Yufei Jia , Ruixiang Wang , Zhucun Xue , Guyue Zhou , Longhua Ma , Guanzhong Tian

Diffusion models have become popular for policy learning in robotics due to their ability to capture high-dimensional and multimodal distributions. However, diffusion policies are stochastic and typically trained offline, limiting their…

Robotics · Computer Science 2025-05-28 Ralf Römer , Alexander von Rohr , Angela P. Schoellig

Trajectory generation for mobile robots in unstructured environments faces a critical dilemma: balancing kinematic smoothness for safe execution with terminal precision for fine-grained tasks. Existing generative planners often struggle…

Robotics · Computer Science 2026-03-03 Jinyang Zhao , Handong Zheng , Yanjiu Zhong , Qiang Zhang , Yu Kang , Shunyu Wu

The conditional diffusion model has been demonstrated as an efficient tool for learning robot policies, owing to its advancement to accurately model the conditional distribution of policies. The intricate nature of real-world scenarios,…

Robotics · Computer Science 2024-07-03 Wenhao Yu , Jie Peng , Huanyu Yang , Junrui Zhang , Yifan Duan , Jianmin Ji , Yanyong Zhang

Robots hold great promise for performing repetitive or hazardous tasks, but achieving human-like dexterity, especially in contact-rich and dynamic environments, remains challenging. Rigid robots, which rely on position or velocity control,…

Robotics · Computer Science 2024-10-28 Malek Aburub , Cristian C. Beltran-Hernandez , Tatsuya Kamijo , Masashi Hamaya