English
Related papers

Related papers: MTDP: A Modulated Transformer based Diffusion Poli…

200 papers

Diffusion-based planners have shown strong potential for autonomous driving by capturing multi-modal driving behaviors. A key challenge is how to effectively guide these models for safe and reactive planning in closed-loop settings, where…

Artificial Intelligence · Computer Science 2026-03-06 Shu Liu , Wenlin Chen , Weihao Li , Zheng Wang , Lijin Yang , Jianing Huang , Yipin Zhang , Zhongzhan Huang , Ze Cheng , Hao Yang

Data imputation and data generation have important applications for many domains, like healthcare and finance, where incomplete or missing data can hinder accurate analysis and decision-making. Diffusion models have emerged as powerful…

Machine Learning · Computer Science 2025-06-10 Mario Villaizán-Vallelado , Matteo Salvatori , Carlos Segura , Ioannis Arapakis

Diffusion models excel at creating images and videos thanks to their multimodal generative capabilities. These same capabilities have made diffusion models increasingly popular in robotics research, where they are used for generating robot…

Robotics · Computer Science 2025-04-29 Jean-Baptiste Bouvier , Kanghyun Ryu , Kartik Nagpal , Qiayuan Liao , Koushil Sreenath , Negar Mehr

This paper explores the utility of diffusion-based models for anomaly detection, focusing on their efficacy in identifying deviations in both compact and high-resolution datasets. Diffusion-based architectures, including Denoising Diffusion…

Machine Learning · Computer Science 2024-12-11 Aryan Bhosale , Samrat Mukherjee , Biplab Banerjee , Fabio Cuzzolin

We present AnchorDP3, a diffusion policy framework for dual-arm robotic manipulation that achieves state-of-the-art performance in highly randomized environments. AnchorDP3 integrates three key innovations: (1) Simulator-Supervised Semantic…

Robotics · Computer Science 2025-06-26 Ziyan Zhao , Ke Fan , He-Yang Xu , Ning Qiao , Bo Peng , Wenlong Gao , Dongjiang Li , Hui Shen

Dynamic point cloud pretraining is still dominated by masked reconstruction objectives. However, these objectives inherit two key limitations. Existing methods inject ground-truth tube centers as decoder positional embeddings, causing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhuoyue Zhang , Jihua Zhu , Chaowei Fang , Jian Liu , Ajmal Saeed Mian

Visual-motor policy learning has advanced with architectures like diffusion-based policies, known for modeling complex robotic trajectories. However, their prolonged inference times hinder high-frequency control tasks requiring real-time…

Robotics · Computer Science 2024-12-20 Bofang Jia , Pengxiang Ding , Can Cui , Mingyang Sun , Pengfang Qian , Siteng Huang , Zhaoxin Fan , Donglin Wang

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

Optimization and Control · Mathematics 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

Diffusion policies generate robot motions by learning to denoise action-space trajectories conditioned on observations. These observations are commonly streams of RGB images, whose high dimensionality includes substantial task-irrelevant…

Robotics · Computer Science 2025-09-18 Xiatao Sun , Yinxing Chen , Daniel Rakita

Flow-matching-based policies have recently emerged as a promising approach for learning-based robot manipulation, offering significant acceleration in action sampling compared to diffusion-based policies. However, conventional flow-matching…

Robotics · Computer Science 2025-10-03 Xuanran Zhai , Qianyou Zhao , Qiaojun Yu , Ce Hao

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

Robotics · Computer Science 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara

Diffusion Probabilistic Models (DPMs) have recently demonstrated impressive results on various generative tasks.Despite its promises, the learned representations of pre-trained DPMs, however, have not been fully understood. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xingyi Yang , Xinchao Wang

Diffusion transformers typically incorporate textual information via attention layers and a modulation mechanism using a pooled text embedding. Nevertheless, recent approaches discard modulation-based text conditioning and rely exclusively…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Nikita Starodubcev , Daniil Pakhomov , Zongze Wu , Ilya Drobyshevskiy , Yuchen Liu , Zhonghao Wang , Yuqian Zhou , Zhe Lin , Dmitry Baranchuk

Learning to navigate in dynamic and complex open-world environments is a critical yet challenging capability for autonomous robots. Existing approaches often rely on cascaded modular frameworks, which require extensive hyperparameter tuning…

Robotics · Computer Science 2025-12-25 Wenzhe Cai , Jiaqi Peng , Yuqiang Yang , Yujian Zhang , Meng Wei , Hanqing Wang , Yilun Chen , Tai Wang , Jiangmiao Pang

Although multi-step generative policies achieve strong performance in robotic manipulation by modeling multimodal action distributions, they require multi-step iterative denoising at inference time. Each action therefore needs tens to…

Robotics · Computer Science 2026-04-22 Yuxuan Gao , Yedong Shen , Shiqi Zhang , Wenhao Yu , Yifan Duan , Jia pan , Jiajia Wu , Jiajun Deng , Yanyong Zhang

Diffusion Policies are effective at learning closed-loop manipulation policies from human demonstrations but generalize poorly to novel arrangements of objects in 3D space, hurting real-world performance. To address this issue, we propose…

Robotics · Computer Science 2025-07-03 Xupeng Zhu , Fan Wang , Robin Walters , Jane Shi

Recent advances in diffusion models hold significant potential in robotics, enabling the generation of diverse and smooth trajectories directly from raw representations of the environment. Despite this promise, applying diffusion models to…

Robotics · Computer Science 2025-07-01 Jinhao Liang , Jacob K Christopher , Sven Koenig , Ferdinando Fioretto

While Diffusion Transformers (DiTs) have achieved notable progress in video generation, this long-sequence generation task remains constrained by the quadratic complexity inherent to self-attention mechanisms, creating significant barriers…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Yuxi Liu , Yipeng Hu , Zekun Zhang , Kunze Jiang , Kun Yuan

The integration of Diffusion Models into Intelligent Transportation Systems (ITS) is a substantial improvement in the detection of accidents. We present a novel hybrid model integrating guidance classification with diffusion techniques. By…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Siva Sai , Saksham Gupta , Vinay Chamola , Rajkumar Buyya

The ability to learn multi-modal action distributions is indispensable for robotic manipulation policies to perform precise and robust control. Flow-based generative models have recently emerged as a promising solution to learning…

Robotics · Computer Science 2025-10-10 Guowei Zou , Haitao Wang , Hejun Wu , Yukun Qian , Yuhang Wang , Weibing Li