English
Related papers

Related papers: RoboFlow4D: A Lightweight Flow World Model Toward …

200 papers

Existing imitation learning methods enable robots to interact autonomously with the physical environment. However, contact-rich manipulation tasks remain a significant challenge due to complex contact dynamics that demand high-precision…

We explore a novel method to perceive and manipulate 3D articulated objects that generalizes to enable a robot to articulate unseen classes of objects. We propose a vision-based system that learns to predict the potential motions of the…

Robotics · Computer Science 2024-05-03 Ben Eisner , Harry Zhang , David Held

Limited by inference latency, existing robot manipulation policies lack sufficient real-time interaction capability with the environment. Although faster generation methods such as flow matching are gradually replacing diffusion methods,…

Robotics · Computer Science 2026-02-17 Zhenchen Dong , Jinna Fu , Jiaming Wu , Shengyuan Yu , Fulin Chen , Yide Liu

Robust and accurate perception of humans in their 3D scene context is essential for integrating robots into everyday environments. Existing approaches, however, often fail to predict plausible and accurate human motion estimates that are…

Robotics · Computer Science 2026-05-26 Simon Schaefer , Joshua Näf , Stefan Leutenegger

Modeling interactive driving behaviors in complex scenarios remains a fundamental challenge for autonomous driving planning. Learning-based approaches attempt to address this challenge with advanced generative models, removing the…

World models have made significant progress in modeling dynamic environments; however, most embodied world models are still restricted to 2D representations, lacking the comprehensive multi-view information essential for embodied spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Peiyan Tu , Hanxin Zhu , Jingwen Sun , Shaojie Ren , Cong Wang , Jiayi Luo , Xiaoqian Cheng , Zhibo Chen

The incorporation of world modeling into manipulation policy learning has pushed the boundary of manipulation performance. However, existing efforts simply model the 2D visual dynamics, which is insufficient for robust manipulation when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuxin He , Ruihao Zhang , Xianzu Wu , Zhiyuan Zhang , Cheng Ding , Qiang Nie

Coordinating a team of robots to reposition multiple objects in cluttered environments requires reasoning jointly about where robots should establish contact, how to manipulate objects once contact is made, and how to navigate safely and…

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jingkang Wang , Henry Che , Yun Chen , Ze Yang , Lily Goli , Sivabalan Manivasagam , Raquel Urtasun

Recent advances in imitation learning for 3D robotic manipulation have shown promising results with diffusion-based policies. However, achieving human-level dexterity requires seamless integration of geometric precision and semantic…

Enabling robots to execute novel manipulation tasks zero-shot is a central goal in robotics. Most existing methods assume in-distribution tasks or rely on fine-tuning with embodiment-matched data, limiting transfer across platforms. We…

Robotics · Computer Science 2025-10-10 Hongyu Li , Lingfeng Sun , Yafei Hu , Duy Ta , Jennifer Barry , George Konidaris , Jiahui Fu

A recent study in turbulent flow simulation demonstrated the potential of generative diffusion models for fast 3D surrogate modeling. This approach eliminates the need for specifying initial states or performing lengthy simulations,…

Fluid Dynamics · Physics 2024-07-30 Abdullah Saydemir , Marten Lienen , Stephan Günnemann

Predicting future states or actions of a given system remains a fundamental, yet unsolved challenge of intelligence, especially in the scope of complex and non-deterministic scenarios, such as modeling behavior of humans. Existing…

Machine Learning · Computer Science 2020-12-01 Maciej Zięba , Marcin Przewięźlikowski , Marek Śmieja , Jacek Tabor , Tomasz Trzcinski , Przemysław Spurek

Robotic manipulation in high-precision tasks is essential for numerous industrial and real-world applications where accuracy and speed are required. Yet current diffusion-based policy learning methods generally suffer from low computational…

Robotics · Computer Science 2025-06-23 Sen Wang , Le Wang , Sanping Zhou , Jingyi Tian , Jiayi Li , Haowen Sun , Wei Tang

Flow-matching-based policies have recently emerged as a promising approach for learning-based robot manipulation, offering significant acceleration in action sampling compared to diffusion-based policies. However, conventional flow-matching…

Robotics · Computer Science 2025-10-03 Xuanran Zhai , Qianyou Zhao , Qiaojun Yu , Ce Hao

While magnetic micro-robots have demonstrated significant potential across various applications, including drug delivery and microsurgery, the open issue of precise navigation and control in complex fluid environments is crucial for in vivo…

Robotics · Computer Science 2025-03-17 Yongyi Jia , Shu Miao , Jiayu Wu , Ming Yang , Chengzhi Hu , Xiang Li

Diffusion-based visuomotor policies excel at modeling action distributions but are inference-inefficient, since recursively denoising from noise to policy requires many steps and heavy UNet backbones, which hinders deployment on…

Robotics · Computer Science 2026-02-16 Zhihao Chen , Yiyuan Ge , Ziyang Wang

Previous dominant methods for scene flow estimation focus mainly on input from two consecutive frames, neglecting valuable information in the temporal domain. While recent trends shift towards multi-frame reasoning, they suffer from rapidly…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Qingwen Zhang , Xiaomeng Zhu , Yushan Zhang , Yixi Cai , Olov Andersson , Patric Jensfelt

World models that support controllable and editable spatiotemporal environments are valuable for robotics, enabling scalable training data, repro ducible evaluation, and flexible task design. While recent text-to-video models generate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xuehai He , Shijie Zhou , Thivyanth Venkateswaran , Kaizhi Zheng , Ziyu Wan , Achuta Kadambi , Xin Eric Wang

Imitation learning and world models have shown significant promise in advancing generalizable robotic learning, with robotic grasping remaining a critical challenge for achieving precise manipulation. Existing methods often rely heavily on…

Robotics · Computer Science 2025-02-06 Yiqi Huang , Travis Davies , Jiahuan Yan , Xiang Chen , Yu Tian , Luhui Hu