English
Related papers

Related papers: R3D2: Realistic 3D Asset Insertion via Diffusion f…

200 papers

3D data simulation aims to bridge the gap between simulated and real-captured 3D data, which is a fundamental problem for real-world 3D visual tasks. Most 3D data simulation methods inject predefined physical priors but struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Mutian Xu , Chongjie Ye , Haolin Liu , Yushuang Wu , Jiahao Chang , Xiaoguang Han

3D object generation from a single image involves estimating the full 3D geometry and texture of unseen views from an unposed RGB image captured in the wild. Accurately reconstructing an object's complete 3D structure and texture has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Hritam Basak , Hadi Tabatabaee , Shreekant Gayaka , Ming-Feng Li , Xin Yang , Cheng-Hao Kuo , Arnie Sen , Min Sun , Zhaozheng Yin

Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Although 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

This paper focuses on scene reconstruction under nighttime conditions in autonomous driving simulation. Recent methods based on Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) have achieved photorealistic modeling in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Tae-Kyeong Kim , Xingxin Chen , Guile Wu , Chengjie Huang , Dongfeng Bai , Bingbing Liu

In autonomous driving, vision-centric 3D detection aims to identify 3D objects from images. However, high data collection costs and diverse real-world scenarios limit the scale of training data. Once distribution shifts occur between…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Hongbin Lin , Zilu Guo , Yifan Zhang , Shuaicheng Niu , Yafeng Li , Ruimao Zhang , Shuguang Cui , Zhen Li

Modeling the 3D world from sensor data for simulation is a scalable way of developing testing and validation environments for robotic learning problems such as autonomous driving. However, manually creating or re-creating real-world-like…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Bokui Shen , Xinchen Yan , Charles R. Qi , Mahyar Najibi , Boyang Deng , Leonidas Guibas , Yin Zhou , Dragomir Anguelov

Existing traffic simulation models often fall short in capturing the intricacies of real-world scenarios, particularly the interactive behaviors among multiple traffic participants, thereby limiting their utility in the evaluation and…

Robotics · Computer Science 2026-02-03 Zhiyu Huang , Zixu Zhang , Ameya Vaidya , Yuxiao Chen , Chen Lv , Jaime Fernández Fisac

Recent advancements in 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) have achieved impressive results in real-time 3D reconstruction and novel view synthesis. However, these methods struggle in large-scale, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Niluthpol Chowdhury Mithun , Tuan Pham , Qiao Wang , Ben Southall , Kshitij Minhas , Bogdan Matei , Stephan Mandt , Supun Samarasekera , Rakesh Kumar

Generating realistic and diverse road scenarios is essential for autonomous vehicle testing and validation. Nevertheless, owing to the complexity and variability of real-world road environments, creating authentic and varied scenarios for…

Robotics · Computer Science 2024-11-15 Junjie Zhou , Lin Wang , Qiang Meng , Xiaofan Wang

The creation of high-quality 3D assets is paramount for applications in digital heritage preservation, entertainment, and robotics. Traditionally, this process necessitates skilled professionals and specialized software for the modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Shen Chen , Jiale Zhou , Zhongyu Jiang , Tianfang Zhang , Zongkai Wu , Jenq-Neng Hwang , Lei Li

We propose GGS, a Generalizable Gaussian Splatting method for Autonomous Driving which can achieve realistic rendering under large viewpoint changes. Previous generalizable 3D gaussian splatting methods are limited to rendering novel views…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Huasong Han , Kaixuan Zhou , Xiaoxiao Long , Yusen Wang , Chunxia Xiao

We present GSD, a diffusion model approach based on Gaussian Splatting (GS) representation for 3D object reconstruction from a single view. Prior works suffer from inconsistent 3D geometry or mediocre rendering quality due to improper…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Yuxuan Mu , Xinxin Zuo , Chuan Guo , Yilin Wang , Juwei Lu , Xiaofeng Wu , Songcen Xu , Peng Dai , Youliang Yan , Li Cheng

The ability to generate virtual environments is crucial for applications ranging from gaming to physical AI domains such as robotics, autonomous driving, and industrial AI. Current learning-based 3D reconstruction methods rely on the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Sherwin Bahmani , Tianchang Shen , Jiawei Ren , Jiahui Huang , Yifeng Jiang , Haithem Turki , Andrea Tagliasacchi , David B. Lindell , Zan Gojcic , Sanja Fidler , Huan Ling , Jun Gao , Xuanchi Ren

Accurate 3D reconstruction of vehicles is vital for applications such as vehicle inspection, predictive maintenance, and urban planning. Existing methods like Neural Radiance Fields and Gaussian Splatting have shown impressive results but…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Davide Di Nucci , Matteo Tomei , Guido Borghi , Luca Ciuffreda , Roberto Vezzani , Rita Cucchiara

Existing diffusion-based text-to-3D generation methods primarily focus on producing visually realistic shapes and appearances, often neglecting the physical constraints necessary for downstream tasks. Generated models frequently fail to…

Machine Learning · Computer Science 2024-11-19 Yunuo Chen , Tianyi Xie , Zeshun Zong , Xuan Li , Feng Gao , Yin Yang , Ying Nian Wu , Chenfanfu Jiang

Recent breakthroughs in radiance fields have significantly advanced 3D scene reconstruction and novel view synthesis (NVS) in autonomous driving. Nevertheless, critical limitations persist: reconstruction-based methods exhibit substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yingshuang Zou , Yikang Ding , Chuanrui Zhang , Jiazhe Guo , Bohan Li , Xiaoyang Lyu , Feiyang Tan , Xiaojuan Qi , Haoqian Wang

Creating realistic and simulation-ready 3D assets is crucial for autonomous driving research and virtual environment construction. However, existing 3D vehicle generation methods are often trained on synthetic data with significant domain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hongyuan Liu , Bochao Zou , Qiankun Liu , Haochen Yu , Qi Mei , Jianfei Jiang , Chen Liu , Cheng Bi , Zhao Wang , Xueyang Zhang , Yifei Zhan , Jiansheng Chen , Huimin Ma

Recent text-guided generation of individual 3D object has achieved great success using diffusion priors. However, these methods are not suitable for object insertion and replacement tasks as they do not consider the background, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Hanyuan Xiao , Yingshu Chen , Huajian Huang , Haolin Xiong , Jing Yang , Pratusha Prasad , Yajie Zhao

The problem of 3D reconstruction from posed images is undergoing a fundamental transformation, driven by continuous advances in 3D Gaussian Splatting (3DGS). By modeling scenes explicitly as collections of 3D Gaussians, 3DGS enables…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Vitor Pereira Matias , Daniel Perazzo , Vinicius Silva , Alberto Raposo , Luiz Velho , Afonso Paiva , Tiago Novello

Photorealistic 3D reconstruction of street scenes is a critical technique for developing real-world simulators for autonomous driving. Despite the efficacy of Neural Radiance Fields (NeRF) for driving scenes, 3D Gaussian Splatting (3DGS)…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Nan Huang , Xiaobao Wei , Wenzhao Zheng , Pengju An , Ming Lu , Wei Zhan , Masayoshi Tomizuka , Kurt Keutzer , Shanghang Zhang