English
Related papers

Related papers: G3Flow: Generative 3D Semantic Flow for Pose-aware…

200 papers

Modeling and understanding the 3D world is crucial for various applications, from augmented reality to robotic navigation. Recent advancements based on 3D Gaussian Splatting have integrated semantic information from multi-view images into…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Xingrui Wang , Cuiling Lan , Hanxin Zhu , Zhibo Chen , Yan Lu

Generating realistic, context-aware two-person motion conditioned on diverse modalities remains a fundamental challenge for graphics, animation and embodied AI systems. Real-world applications such as VR/AR companions, social robotics and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Prerit Gupta , Shourya Verma , Ananth Grama , Aniket Bera

We present AnchorDP3, a diffusion policy framework for dual-arm robotic manipulation that achieves state-of-the-art performance in highly randomized environments. AnchorDP3 integrates three key innovations: (1) Simulator-Supervised Semantic…

Robotics · Computer Science 2025-06-26 Ziyan Zhao , Ke Fan , He-Yang Xu , Ning Qiao , Bo Peng , Wenlong Gao , Dongjiang Li , Hui Shen

Diffusion and flow-based models have become the state of the art for generative AI across a wide range of data modalities, including images, videos, shapes, molecules, music, and more. This tutorial provides a self-contained introduction to…

Machine Learning · Computer Science 2026-03-19 Peter Holderrieth , Ezra Erives

Understanding and predicting object motion from egocentric video is fundamental to embodied perception and interaction. However, generating physically consistent 6DoF trajectories remains challenging due to occlusions, fast motion, and the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Abhishek Saroha , Huajian Zeng , Xingxing Zuo , Daniel Cremers , Xi Wang

Object pose estimation is a fundamental problem in robotics and computer vision, yet it remains challenging due to partial observability, occlusions, and object symmetries, which inevitably lead to pose ambiguity and multiple hypotheses…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yufeng Jin , Niklas Funk , Vignesh Prasad , Zechu Li , Mathias Franzius , Jan Peters , Georgia Chalvatzaki

Generating realistic 3D hand-object interactions (HOI) is a fundamental challenge in computer vision and robotics, requiring both temporal coherence and high-fidelity physical plausibility. Existing methods remain limited in their ability…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zerui Chen , Rolandos Alexandros Potamias , Shizhe Chen , Jiankang Deng , Cordelia Schmid , Stefanos Zafeiriou

Diffusion generative modeling has become a promising approach for learning robotic manipulation tasks from stochastic human demonstrations. In this paper, we present Diffusion-EDFs, a novel SE(3)-equivariant diffusion-based approach for…

In recent years, 3D vision has become a crucial field within computer vision, powering a wide range of applications such as autonomous driving, robotics, augmented reality, and medical imaging. This field relies on accurate perception,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhen Wang , Dongyuan Li , Yaozu Wu , Tianyu He , Jiang Bian , Renhe Jiang

Diffusion-based models for robotic control, including vision-language-action (VLA) and vision-action (VA) policies, have demonstrated significant capabilities. Yet their advancement is constrained by the high cost of acquiring large-scale…

Flow-matching models have recently emerged as a powerful framework for continuous generative modeling, including 3D point cloud synthesis. However, their deployment is limited by the need for multiple sequential sampling steps at inference…

Machine Learning · Computer Science 2026-03-20 Elaheh Akbari , Shansita Sharma , Ping He , Ahmadreza Moradipari , Kyungtae Han , Hamed Pirsiavash , Yikun Bai , Soheil Kolouri

For humans, visual understanding is inherently generative: given a 3D shape, we can postulate how it would look in the world; given a 2D image, we can infer the 3D structure that likely gave rise to it. We can thus translate between the 2D…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Tristan Aumentado-Armstrong , Alex Levinshtein , Stavros Tsogkas , Konstantinos G. Derpanis , Allan D. Jepson

Semantic correspondence, the task of determining relationships between different parts of images, underpins various applications including 3D reconstruction, image-to-image translation, object tracking, and visual place recognition. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Frank Fundel , Johannes Schusterbauer , Vincent Tao Hu , Björn Ommer

Deep learning-based image enhancement methods face a fundamental trade-off between computational efficiency and representational capacity. For example, although a conventional three-dimensional Look-Up Table (3D LUT) can process a degraded…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Liubing Hu , Chen Wu , Anrui Wang , Dianjie Lu , Guijuan Zhang , Zhuoran Zheng

We tackle the problem of sampling from intractable high-dimensional density functions, a fundamental task that often appears in machine learning and statistics. We extend recent sampling-based approaches that leverage controlled stochastic…

Machine Learning · Computer Science 2024-03-12 Dinghuai Zhang , Ricky T. Q. Chen , Cheng-Hao Liu , Aaron Courville , Yoshua Bengio

Precise object placement remains underexplored in aerial manipulation, where most systems rely on predefined target coordinates and focus primarily on grasping and control. Specifying exact placement poses, however, is cumbersome in…

Robotics · Computer Science 2026-03-10 Sarthak Mishra , Rishabh Dev Yadav , Naveen Nair , Wei Pan , Spandan Roy

The incorporation of world modeling into manipulation policy learning has pushed the boundary of manipulation performance. However, existing efforts simply model the 2D visual dynamics, which is insufficient for robust manipulation when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yuxin He , Ruihao Zhang , Xianzu Wu , Zhiyuan Zhang , Cheng Ding , Qiang Nie

Early detection of developmental disorders can be aided by analyzing infant craniofacial morphology, but modeling infant faces is challenging due to limited data and frequent spontaneous expressions. We introduce BabyFlow, a generative AI…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Antonia Alomar , Mireia Masias , Marius George Linguraru , Federico M. Sukno , Gemma Piella

Diffusion models have revolutionized generative tasks through high-fidelity outputs, yet flow matching (FM) offers faster inference and empirical performance gains. However, current foundation FM models are computationally prohibitive for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Johannes Schusterbauer , Ming Gui , Frank Fundel , Björn Ommer

Flow based generative models have charted an impressive path across multiple visual generation tasks by adhering to a simple principle: learning velocity representations of a linear interpolant. However, we observe that training velocity…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Inkyu Shin , Chenglin Yang , Liang-Chieh Chen