English
Related papers

Related papers: Trajectory-Consistent Flow Matching for Robust Vis…

200 papers

Existing imitation learning methods enable robots to interact autonomously with the physical environment. However, contact-rich manipulation tasks remain a significant challenge due to complex contact dynamics that demand high-precision…

State-of-the-art scene flow algorithms pursue the conflicting targets of accuracy, run time, and robustness. With the successful concept of pixel-wise matching and sparse-to-dense interpolation, we push the limits of scene flow estimation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 René Schuster , Oliver Wasenmüller , Christian Unger , Georg Kuschk , Didier Stricker

Feature matching across video streams remains a cornerstone challenge in computer vision. Increasingly, robust multimodal matching has garnered interest in robotics, surveillance, remote sensing, and medical imaging. While traditional rely…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Jie Wang , Chen Ye Gan , Caoqi Wei , Jiangtao Wen , Yuxing Han

Behavior cloning methods for robot learning suffer from poor generalization due to limited data support beyond expert demonstrations. Recent approaches leveraging video prediction models have shown promising results by learning rich…

Visuomotor policies aim to learn complex manipulation tasks from expert demonstrations. However, generating smooth and coherent trajectories remains challenging, as it requires balancing proximal precision with distal foresight. Existing…

Robotics · Computer Science 2026-05-21 Qian He , Zhenshuo Yang , Wenqi Liang , Chunhui Hao , Nicu Sebe , Jiandong Tian

Efficient and accurate motion prediction is crucial for ensuring safety and informed decision-making in autonomous driving, particularly under dynamic real-world conditions that necessitate multi-modal forecasts. We introduce TrajFlow, a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Qi Yan , Brian Zhang , Yutong Zhang , Daniel Yang , Joshua White , Di Chen , Jiachao Liu , Langechuan Liu , Binnan Zhuang , Shaoshuai Shi , Renjie Liao

Flow-matching policies have emerged as a powerful paradigm for generalist robotics. These models are trained to imitate an action chunk, conditioned on sensor observations and textual instructions. Often, training demonstrations are…

Machine Learning · Computer Science 2025-07-22 Samuel Pfrommer , Yixiao Huang , Somayeh Sojoudi

We study Variational Rectified Flow Matching, a framework that enhances classic rectified flow matching by modeling multi-modal velocity vector-fields. At inference time, classic rectified flow matching 'moves' samples from a source…

Machine Learning · Computer Science 2025-02-14 Pengsheng Guo , Alexander G. Schwing

Recent advances in generative modeling have led to promising results in robot motion planning, particularly through diffusion and flow matching (FM)-based models that capture complex, multimodal trajectory distributions. However, these…

Robotics · Computer Science 2025-11-13 Xiaobing Dai , Zewen Yang , Dian Yu , Fangzhou Liu , Hamid Sadeghian , Sami Haddadin , Sandra Hirche

Asynchronous inference has emerged as a prevalent paradigm in robotic manipulation, achieving significant progress in ensuring trajectory smoothness and efficiency. However, a systemic challenge remains unresolved, as inherent latency…

Robotics · Computer Science 2026-04-14 Haoyu Wei , Xiuwei Xu , Ziyang Cheng , Hang Yin , Angyuan Ma , Bingyao Yu , Jie Zhou , Jiwen Lu

Safe and computationally efficient local planning for mobile robots in dense, unstructured human crowds remains a fundamental challenge. Moreover, ensuring that robot trajectories are similar to how a human moves will increase the…

Autonomous vehicle navigation is a key challenge in artificial intelligence, requiring robust and accurate decision-making processes. This research introduces a new end-to-end method that exploits multimodal information from a single…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Fouad Makiyeh , Mark Bastourous , Anass Bairouk , Wei Xiao , Mirjana Maras , Tsun-Hsuan Wangb , Marc Blanchon , Ramin Hasani , Patrick Chareyre , Daniela Rus

Likelihood-based policy gradient methods are the dominant approach for training robot control policies from rewards. These methods rely on differentiable action likelihoods, which constrain policy outputs to simple distributions like…

The emerging integration of robots into everyday life brings several major challenges. Compared to classical industrial applications, more flexibility is needed in combination with real-time reactivity. Learning-based methods can train…

Robotics · Computer Science 2026-02-18 Thies Oelerich , Gerald Ebmer , Christian Hartl-Nesic , Andreas Kugi

Generative policies based on diffusion models and flow matching have shown strong promise for offline reinforcement learning (RL), but their applicability remains largely confined to continuous action spaces. To address a broader range of…

Machine Learning · Computer Science 2026-05-14 Fairoz Nower Khan , Nabuat Zaman Nahim , Ruiquan Huang , Haibo Yang , Peizhong Ju

Visual imitation learning is effective for robots to learn versatile tasks. However, many existing methods rely on behavior cloning with supervised historical trajectories, limiting their 3D spatial and 4D spatiotemporal awareness.…

Robotics · Computer Science 2025-07-15 Zhenyang Liu , Yikai Wang , Kuanning Wang , Longfei Liang , Xiangyang Xue , Yanwei Fu

Generative models have become increasingly powerful tools for robot motion generation, enabling flexible and multimodal trajectory generation across various tasks. Yet, most existing approaches remain limited in handling multiple types of…

Robotics · Computer Science 2026-01-15 Zewen Yang , Xiaobing Dai , Dian Yu , Zhijun Li , Majid Khadiv , Sandra Hirche , Sami Haddadin

Learning from expert demonstrations is a promising approach for training robotic manipulation policies from limited data. However, imitation learning algorithms require a number of design choices ranging from the input modality, training…

Robotics · Computer Science 2024-09-12 Eugenio Chisari , Nick Heppert , Max Argus , Tim Welschehold , Thomas Brox , Abhinav Valada

Due to the scarcity of annotated scene flow data, self-supervised scene flow learning in point clouds has attracted increasing attention. In the self-supervised manner, establishing correspondences between two point clouds to approximate…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Ruibo Li , Guosheng Lin , Lihua Xie

In robot manipulation, robot learning has become a prevailing approach. However, generative models within this field face a fundamental trade-off between the slow, iterative sampling of diffusion models and the architectural constraints of…

Robotics · Computer Science 2025-12-04 Juyi Sheng , Ziyi Wang , Peiming Li , Mengyuan Liu