English
Related papers

Related papers: U4D: Uncertainty-Aware 4D World Modeling from LiDA…

200 papers

Reconstructing 3D scenes from a single image is a fundamentally ill-posed task due to the severely under-constrained nature of the problem. Consequently, when the scene is rendered from novel camera views, existing single image to 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Sarosij Bose , Arindam Dutta , Sayak Nag , Junge Zhang , Jiachen Li , Konstantinos Karydis , Amit K. Roy Chowdhury

Large-scale diffusion generative models are greatly simplifying image, video and 3D asset creation from user-provided text prompts and images. However, the challenging problem of text-to-4D dynamic 3D scene generation with diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Yufeng Zheng , Xueting Li , Koki Nagano , Sifei Liu , Karsten Kreis , Otmar Hilliges , Shalini De Mello

Tracking non-rigidly deforming scenes using range sensors has numerous applications including computer vision, AR/VR, and robotics. However, due to occlusions and physical limitations of range sensors, existing methods only handle the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Yang Li , Hikari Takehara , Takafumi Taketomi , Bo Zheng , Matthias Nießner

Generating dynamic 3D object from a single-view video is challenging due to the lack of 4D labeled data. An intuitive approach is to extend previous image-to-3D pipelines by transferring off-the-shelf image generation models such as score…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Zijie Pan , Zeyu Yang , Xiatian Zhu , Li Zhang

Scene flow allows autonomous vehicles to reason about the arbitrary motion of multiple independent objects which is the key to long-term mobile autonomy. While estimating the scene flow from LiDAR has progressed recently, it remains largely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Fangqiang Ding , Zhijun Pan , Yimin Deng , Jianning Deng , Chris Xiaoxuan Lu

The blooming of virtual reality and augmented reality (VR/AR) technologies has driven an increasing demand for the creation of high-quality, immersive, and dynamic environments. However, existing generative techniques either focus solely on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Renjie Li , Panwang Pan , Bangbang Yang , Dejia Xu , Shijie Zhou , Xuanyang Zhang , Zeming Li , Achuta Kadambi , Zhangyang Wang , Zhengzhong Tu , Zhiwen Fan

Generative world models offer a compelling foundation for augmented-reality (AR) applications: by predicting future image sequences that incorporate deliberate visual edits, they enable temporally coherent, augmented future frames that can…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Fanjun Bu , Chenyang Yuan , Hiroshi Yasuda

Simulating robot-world interactions is a cornerstone of Embodied AI. Recently, a few works have shown promise in leveraging video generations to transcend the rigid visual/physical constraints of traditional simulators. However, they…

Robotics · Computer Science 2026-03-18 Mutian Xu , Tianbao Zhang , Tianqi Liu , Zhaoxi Chen , Xiaoguang Han , Ziwei Liu

Recovering 4D from monocular video, which jointly estimates dynamic geometry and camera poses, is an inevitably challenging problem. While recent pointmap-based 3D reconstruction methods (e.g., DUSt3R) have made great progress in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Shizun Wang , Zhenxiang Jiang , Xingyi Yang , Xinchao Wang

LiDAR representation learning has emerged as a promising approach to reducing reliance on costly and labor-intensive human annotations. While existing methods primarily focus on spatial alignment between LiDAR and camera sensors, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xiang Xu , Lingdong Kong , Hui Shuai , Wenwei Zhang , Liang Pan , Kai Chen , Ziwei Liu , Qingshan Liu

We present a robust real-time LiDAR 3D object detector that leverages heteroscedastic aleatoric uncertainties to significantly improve its detection performance. A multi-loss function is designed to incorporate uncertainty estimations…

Robotics · Computer Science 2019-05-07 Di Feng , Lars Rosenbaum , Fabian Timm , Klaus Dietmayer

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

Recent advancements in generative models have ignited substantial interest in dynamic 3D content creation (\ie, 4D generation). Existing approaches primarily rely on Score Distillation Sampling (SDS) to infer novel-view videos, typically…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Hanxin Zhu , Tianyu He , Xiqian Yu , Junliang Guo , Zhibo Chen , Jiang Bian

Just as humans can become disoriented in featureless deserts or thick fogs, not all environments are conducive to the Localization Accuracy and Stability (LAS) of autonomous robots. This paper introduces an efficient framework designed to…

Robotics · Computer Science 2024-08-06 Kaixin Chai , Long Xu , Qianhao Wang , Chao Xu , Peng Yin , Fei Gao

We introduce Diff4Splat, a feed-forward method that synthesizes controllable and explicit 4D scenes from a single image. Our approach unifies the generative priors of video diffusion models with geometry and motion constraints learned from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Panwang Pan , Chenguo Lin , Jingjing Zhao , Chenxin Li , Yuchen Lin , Haopeng Li , Honglei Yan , Kairun Wen , Yunlong Lin , Yixuan Yuan , Yadong Mu

Unsupervised 3D object detection aims to identify objects of interest from unlabeled raw data, such as LiDAR points. Recent approaches usually adopt pseudo 3D bounding boxes (3D bboxes) from clustering algorithm to initialize the model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Ruiyang Zhang , Hu Zhang , Hang Yu , Zhedong Zheng

Simulation models for perception sensors are integral components of automotive simulators used for the virtual Verification and Validation (V\&V) of Autonomous Driving Systems (ADS). These models also serve as powerful tools for generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hamed Haghighi , Mehrdad Dianati , Valentina Donzella , Kurt Debattista

Generative world models are reshaping embodied AI, enabling agents to synthesize realistic 4D driving environments that look convincing but often fail physically or behaviorally. Despite rapid progress, the field still lacks a unified way…

Multi-agent trajectory modeling has primarily focused on forecasting future states, often overlooking broader tasks like trajectory completion, which are crucial for real-world applications such as correcting tracking data. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Guillem Capellera , Antonio Rubio , Luis Ferraz , Antonio Agudo

Existing displacement strategies in semi-supervised segmentation only operate on rectangular regions, ignoring anatomical structures and resulting in boundary distortions and semantic inconsistency. To address these issues, we propose UCAD,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chengbo Ding , Fenghe Tang , Shaohua Kevin Zhou