English
Related papers

Related papers: Online Diffusion-Based 3D Occupancy Prediction at …

200 papers

Reinforcement Learning (RL)-based motion planning has recently shown the potential to outperform traditional approaches from autonomous navigation to robot manipulation. In this work, we focus on a motion planning task for an evasive target…

Robotics · Computer Science 2025-05-12 Zixuan Wu , Sean Ye , Manisha Natarajan , Matthew C. Gombolay

Inferring the 3D structure from a single image, particularly in occluded regions, remains a fundamental yet unsolved challenge in vision-centric autonomous driving. Existing unsupervised approaches typically train a neural radiance field…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Zizhan Guo , Yi Feng , Mengtan Zhang , Haoran Zhang , Wei Ye , Rui Fan

3D semantic occupancy prediction is one of the crucial tasks of autonomous driving. It enables precise and safe interpretation and navigation in complex environments. Reliable predictions rely on effective sensor fusion, as different…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Tomislav Pavković , Mohammad-Ali Nikouei Mahani , Johannes Niedermayer , Johannes Betz

The completion, extension, and generation of 3D semantic scenes are an interrelated set of capabilities that are useful for robotic navigation and exploration. Existing approaches seek to decouple these problems and solve them one-off.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xujia Zhang , Brendan Crowe , Christoffer Heckman

The conditional diffusion model has been demonstrated as an efficient tool for learning robot policies, owing to its advancement to accurately model the conditional distribution of policies. The intricate nature of real-world scenarios,…

Robotics · Computer Science 2024-07-03 Wenhao Yu , Jie Peng , Huanyu Yang , Junrui Zhang , Yifan Duan , Jianmin Ji , Yanyong Zhang

The field of autonomous driving is experiencing a surge of interest in world models, which aim to predict potential future scenarios based on historical observations. In this paper, we introduce DFIT-OccWorld, an efficient 3D occupancy…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Haiming Zhang , Ying Xue , Xu Yan , Jiacheng Zhang , Weichao Qiu , Dongfeng Bai , Bingbing Liu , Shuguang Cui , Zhen Li

Predicting how the world can evolve in the future is crucial for motion planning in autonomous systems. Classical methods are limited because they rely on costly human annotations in the form of semantic class labels, bounding boxes, and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Tarasha Khurana , Peiyun Hu , David Held , Deva Ramanan

Achieving generalizable and precise robotic manipulation across diverse environments remains a critical challenge, largely due to limitations in spatial perception. While prior imitation-learning approaches have made progress, their…

Robotics · Computer Science 2025-05-28 Yiqi Huang , Travis Davies , Jiahuan Yan , Jiankai Sun , Xiang Chen , Luhui Hu

Determining the occupancy status of locations in the environment is a fundamental task for safety-critical robotic applications. Traditional occupancy grid mapping methods subdivide the environment into a grid of voxels, each associated…

Robotics · Computer Science 2026-03-24 Benxu Tang , Yunfan Ren , Yixi Cai , Fanze Kong , Wenyi Liu , Fangcheng Zhu , Longji Yin , Liuyu Shi , Fu Zhang

Vision-based perception for autonomous driving requires an explicit modeling of a 3D space, where 2D latent representations are mapped and subsequent 3D operators are applied. However, operating on dense latent spaces introduces a cubic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Pin Tang , Zhongdao Wang , Guoqing Wang , Jilai Zheng , Xiangxuan Ren , Bailan Feng , Chao Ma

Human driver can easily describe the complex traffic scene by visual system. Such an ability of precise perception is essential for driver's planning. To achieve this, a geometry-aware representation that quantizes the physical 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Chonghao Sima , Wenwen Tong , Tai Wang , Li Chen , Silei Wu , Hanming Deng , Yi Gu , Lewei Lu , Ping Luo , Dahua Lin , Hongyang Li

The task of motion prediction is pivotal for autonomous driving systems, providing crucial data to choose a vehicle behavior strategy within its surroundings. Existing motion prediction techniques primarily focus on predicting the future…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Youshaa Murhij , Dmitry Yudin

For autonomous vehicles to proactively plan safe trajectories and make informed decisions, they must be able to predict the future occupancy states of the local environment. However, common issues with occupancy prediction include…

Robotics · Computer Science 2024-04-15 Maneekwan Toyungyernsub , Esen Yel , Jiachen Li , Mykel J. Kochenderfer

In this paper, we aim to forecast a future trajectory distribution of a moving agent in the real world, given the social scene images and historical trajectories. Yet, it is a challenging task because the ground-truth distribution is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Ke Guo , Wenxi Liu , Jia Pan

Occupancy mapping has been widely utilized to represent the surroundings for autonomous robots to perform tasks such as navigation and manipulation. While occupancy mapping in 2-D environments has been well-studied, there have been few…

Robotics · Computer Science 2023-02-28 Juyeop Han , Youngjae Min , Hyeok-Joo Chae , Byeong-Min Jeong , Han-Lim Choi

Occupancy Network has recently attracted much attention in autonomous driving. Instead of monocular 3D detection and recent bird's eye view(BEV) models predicting 3D bounding box of obstacles, Occupancy Network predicts the category of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Mingjie Lu , Yuanxian Huang , Ji Liu , Xingliang Huang , Dong Li , Jinzhang Peng , Lu Tian , Emad Barsoum

Internet overuse is a widespread phenomenon in today's digital society. Existing interventions, such as time limits or grayscaling, often rely on restrictive controls that provoke psychological reactance and are frequently circumvented.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Christoph Gebhardt , Robin Willardt , Seyedmorteza Sadat , Chih-Wei Ning , Andreas Brombach , Jie Song , Otmar Hilliges , Christian Holz

Autonomous driving has the potential to significantly enhance productivity and provide numerous societal benefits. Ensuring robustness in these safety-critical systems is essential, particularly when vehicles must navigate adverse weather…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Severin Heidrich , Till Beemelmanns , Alexey Nekrasov , Bastian Leibe , Lutz Eckstein

Recent diffusion models have demonstrated remarkable performance in both 3D scene generation and perception tasks. Nevertheless, existing methods typically separate these two processes, acting as a data augmenter to generate synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Bohan Li , Xin Jin , Jianan Wang , Yukai Shi , Yasheng Sun , Xiaofeng Wang , Zhuang Ma , Baao Xie , Chao Ma , Xiaokang Yang , Wenjun Zeng

3D semantic occupancy prediction is crucial for autonomous driving, providing a dense, semantically rich environmental representation. However, existing methods focus on in-distribution scenes, making them susceptible to Out-of-Distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yuheng Zhang , Mengfei Duan , Kunyu Peng , Yuhang Wang , Ruiping Liu , Fei Teng , Kai Luo , Zhiyong Li , Kailun Yang