English
Related papers

Related papers: VO-DP: Semantic-Geometric Adaptive Diffusion Polic…

200 papers

Humanoid loco-manipulation requires coordinated high-level motion plans with stable, low-level whole-body execution under complex robot-environment dynamics and long-horizon tasks. While diffusion policies (DPs) show promise for learning…

Robotic manipulation tasks often rely on static cameras for perception, which can limit flexibility, particularly in scenarios like robotic surgery and cluttered environments where mounting static cameras is impractical. Ideally, robots…

Robotics · Computer Science 2025-09-18 Xiatao Sun , Francis Fan , Yinxing Chen , Daniel Rakita

Diffusion policies have recently emerged as a powerful class of visuomotor controllers for robot manipulation, offering stable training and expressive multi-modal action modeling. However, existing approaches typically treat action…

Robotics · Computer Science 2025-10-01 Zezeng Li , Rui Yang , Ruochen Chen , ZhongXuan Luo , Liming Chen

Vision-Language-Action models have emerged as a promising paradigm for robotic manipulation by unifying perception, language grounding, and action generation. However, they often struggle in scenarios requiring precise spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Tao Lin , Yuxin Du , Jiting Liu , Nuobei Zhu , Yunhe Li , Yuqian Fu , Yinxinyu Chen , Hongyi Cai , Zewei Ye , Bing Cheng , Kai Ye , Yiran Mao , Yilei Zhong , MingKang Dong , Junchi Yan , Gen Li , Bo Zhao

Learning-based monocular visual odometry (VO) poses robustness, generalization, and efficiency challenges in robotics. Recent advances in visual foundation models, such as DINOv2, have improved robustness and generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Maulana Bisyir Azhari , David Hyunchul Shim

Robotic manipulation with Vision-Language-Action models requires efficient inference over long-horizon multi-modal context, where attention to dense visual tokens dominates computational cost. Existing methods optimize inference speed by…

Robotics · Computer Science 2025-09-29 Xiaohuan Pei , Yuxing Chen , Siyu Xu , Yunke Wang , Yuheng Shi , Chang Xu

Multi-agent robotic manipulation remains challenging due to the combined demands of coordination, grasp stability, and collision avoidance in shared workspaces. To address these challenges, we propose the Adaptive Dynamic Modality Diffusion…

Robotics · Computer Science 2026-02-26 Enyi Wang , Wen Fan , Dandan Zhang

Contact-rich manipulation is central to many everyday human activities, requiring continuous adaptation to contact uncertainty and external disturbances through multi-modal perception, particularly vision and tactile feedback. While…

Robotics · Computer Science 2026-04-28 Teng Xue , Alberto Rigo , Bingjian Huang , Jiayi Shen , Zhengtong Xu , Nick Colonnese , Amirhossein H. Memar

Decision-making in robotics using denoising diffusion processes has increasingly become a hot research topic, but end-to-end policies perform poorly in tasks with rich contact and have limited controllability. This paper proposes…

Robotics · Computer Science 2024-11-21 Dexin Wang , Chunsheng Liu , Faliang Chang , Yichen Xu

We hypothesize that a key bottleneck in generalizable robot manipulation is not solely data scale or policy capacity, but a structural mismatch between current visual backbones and the physical requirements of closed-loop control. While…

Robotics · Computer Science 2026-02-13 Yu Deng , Yufeng Jin , Xiaogang Jia , Jiahong Xue , Gerhard Neumann , Georgia Chalvatzaki

The practical applications of diffusion models have been limited by the misalignment between generated images and corresponding text prompts. Recent studies have introduced direct preference optimization (DPO) to enhance the alignment of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Zijing Hu , Fengda Zhang , Kun Kuang

In this work we present a monocular visual odometry (VO) algorithm which leverages geometry-based methods and deep learning. Most existing VO/SLAM systems with superior performance are based on geometry and have to be carefully designed for…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Huangying Zhan , Chamara Saroj Weerasekera , Jiawang Bian , Ian Reid

Diffusion policies have demonstrated strong performance in generative modeling, making them promising for robotic manipulation guided by natural language instructions. However, generalizing language-conditioned diffusion policies to…

Robotics · Computer Science 2025-08-20 Ce Hao , Kelvin Lin , Zhiwei Xue , Siyuan Luo , Harold Soh

General visual representations learned from web-scale datasets for robotics have achieved great success in recent years, enabling data-efficient robot learning on manipulation tasks; yet these pre-trained representations are mostly on 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Chengkai Hou , Yanjie Ze , Yankai Fu , Zeyu Gao , Songbo Hu , Yue Yu , Shanghang Zhang , Huazhe Xu

Recently, Vision-Language-Action models (VLA) have advanced robot imitation learning, but high data collection costs and limited demonstrations hinder generalization and current imitation learning methods struggle in out-of-distribution…

Robotics · Computer Science 2026-02-24 Shichao Fan , Quantao Yang , Yajie Liu , Kun Wu , Zhengping Che , Qingjie Liu , Min Wan

We present AnchorDP3, a diffusion policy framework for dual-arm robotic manipulation that achieves state-of-the-art performance in highly randomized environments. AnchorDP3 integrates three key innovations: (1) Simulator-Supervised Semantic…

Robotics · Computer Science 2025-06-26 Ziyan Zhao , Ke Fan , He-Yang Xu , Ning Qiao , Bo Peng , Wenlong Gao , Dongjiang Li , Hui Shen

Diffusion models, praised for their success in generative tasks, are increasingly being applied to robotics, demonstrating exceptional performance in behavior cloning. However, their slow generation process stemming from iterative denoising…

Goal-conditioned dynamic manipulation is inherently challenging due to complex system dynamics and stringent task constraints, particularly in deformable object scenarios characterized by high degrees of freedom and underactuation. Prior…

Robotics · Computer Science 2025-05-26 Guanzhou Lan , Yuqi Yang , Anup Teejo Mathew , Feiping Nie , Rong Wang , Xuelong Li , Federico Renda , Bin Zhao

Imitation learning with diffusion models has advanced robotic control by capturing the multi-modal action distributions. However, existing methods typically treat observations only as high-level conditions to the denoising network, rather…

Artificial Intelligence · Computer Science 2026-02-05 Zhaoyang Liu , Mokai Pan , Zhongyi Wang , Kaizhen Zhu , Haotao Lu , Haipeng Zhang , Jingya Wang , Ye Shi

Recently, end-to-end robotic manipulation models have gained significant attention for their generalizability and scalability. However, they often suffer from limited robustness to camera viewpoint changes when training with a fixed camera.…

Robotics · Computer Science 2026-04-24 Songen Gu , Yuhang Zheng , Weize Li , Yupeng Zheng , Yating Feng , Xiang Li , Yilun Chen , Pengfei Li , Wenchao Ding