English
Related papers

Related papers: R3D2: Realistic 3D Asset Insertion via Diffusion f…

200 papers

We introduce GeoGS3D, a novel two-stage framework for reconstructing detailed 3D objects from single-view images. Inspired by the success of pre-trained 2D diffusion models, our method incorporates an orthogonal plane decomposition…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Qijun Feng , Zhen Xing , Zuxuan Wu , Yu-Gang Jiang

High-fidelity and controllable 3D simulation is essential for addressing the long-tail data scarcity in Autonomous Driving (AD), yet existing methods struggle to simultaneously achieve photorealistic rendering and interactive traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Zhiyuan Liu , Daocheng Fu , Pinlong Cai , Lening Wang , Ying Liu , Yilong Ren , Botian Shi , Jianqiang Wang

3D asset generation plays a pivotal role in fields such as gaming and virtual reality, enabling the rapid synthesis of high-fidelity 3D objects from a single or multiple images. Building on this capability, enabling style-controllable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yiran Qiao , Yiren Lu , Yunlai Zhou , Disheng Liu , Linlin Hou , Rui Yang , Yu Yin , Jing Ma

Recent advances in diffusion models have made significant progress in digital human generation. However, most existing models still struggle to maintain 3D consistency, temporal coherence, and motion accuracy. A key reason for these…

Graphics · Computer Science 2025-03-21 Xuan Gao , Jingtao Zhou , Dongyu Liu , Yuqi Zhou , Juyong Zhang

Modern learning-based approaches to 3D-aware image synthesis achieve high photorealism and 3D-consistent viewpoint changes for the generated images. Existing approaches represent instances in a shared canonical space. However, for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Katja Schwarz , Seung Wook Kim , Jun Gao , Sanja Fidler , Andreas Geiger , Karsten Kreis

Real-time reconstruction of deformable surgical scenes is vital for advancing robotic surgery, improving surgeon guidance, and enabling automation. Recent methods achieve dense reconstructions from da Vinci robotic surgery videos, with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Tianyi Song , Danail Stoyanov , Evangelos Mazomenos , Francisco Vasconcelos

Generating novel views of a natural scene, e.g., every-day scenes both indoors and outdoors, from a single view is an under-explored problem, even though it is an organic extension to the object-centric novel view synthesis. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Wonbong Jang , Jonathan Tremblay , Lourdes Agapito

While the field of 3D scene reconstruction is dominated by NeRFs due to their photorealistic quality, 3D Gaussian Splatting (3DGS) has recently emerged, offering similar quality with real-time rendering speeds. However, both methods…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jonas Kulhanek , Songyou Peng , Zuzana Kukelova , Marc Pollefeys , Torsten Sattler

Robot manipulation in the real world is fundamentally constrained by the visual sim2real gap, where depth observations collected in simulation fail to reflect the complex noise patterns inherent to real sensors. In this work, inspired by…

Robotics · Computer Science 2025-12-09 Xiujian Liang , Jiacheng Liu , Mingyang Sun , Qichen He , Cewu Lu , Jianhua Sun

Datasets are essential for training and testing vehicle perception algorithms. However, the collection and annotation of real-world images is time-consuming and expensive. Driving simulators offer a solution by automatically generating…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Haonan Zhao , Yiting Wang , Thomas Bashford-Rogers , Valentina Donzella , Kurt Debattista

High-Fidelity 3D scene reconstruction plays a crucial role in autonomous driving by enabling novel data generation from existing datasets. This allows simulating safety-critical scenarios and augmenting training datasets without incurring…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Pou-Chun Kung , Skanda Harisha , Ram Vasudevan , Aline Eid , Katherine A. Skinner

Realistic simulation is key to enabling safe and scalable development of % self-driving vehicles. A core component is simulating the sensors so that the entire autonomy system can be tested in simulation. Sensor simulation involves modeling…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jingkang Wang , Sivabalan Manivasagam , Yun Chen , Ze Yang , Ioan Andrei Bârsan , Anqi Joyce Yang , Wei-Chiu Ma , Raquel Urtasun

In recent years, autonomous driving has significantly in creased the demand for high-quality data to train 2D and 3D perception models for safety-critical scenarios. Real world datasets struggle to meet this demand as require ments…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Arka Bhowmick , Enes Ozeren , Ahmed Abdullah , Oliver Wasenmuller

Autonomous driving systems rely heavily on multimodal perception data to understand complex environments. However, the long-tailed distribution of real-world data hinders generalization, especially for rare but safety-critical vehicle…

Artificial Intelligence · Computer Science 2025-08-01 Shouyi Lu , Zihan Lin , Chao Lu , Huanran Wang , Guirong Zhuo , Lianqing Zheng

Datasets are essential to train and evaluate computer vision models used for traffic analysis and to enhance road safety. Existing real datasets fit real-world scenarios, capturing authentic road object behaviors, however, they typically…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Simone Teglia , Claudia Melis Tonti , Francesco Pro , Leonardo Russo , Andrea Alfarano , Leonardo Pentassuglia , Irene Amerini

In recent years, 3D vision has become a crucial field within computer vision, powering a wide range of applications such as autonomous driving, robotics, augmented reality, and medical imaging. This field relies on accurate perception,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Zhen Wang , Dongyuan Li , Yaozu Wu , Tianyu He , Jiang Bian , Renhe Jiang

Diffusion models have recently become the de-facto approach for generative modeling in the 2D domain. However, extending diffusion models to 3D is challenging due to the difficulties in acquiring 3D ground truth data for training. On the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jiatao Gu , Qingzhe Gao , Shuangfei Zhai , Baoquan Chen , Lingjie Liu , Josh Susskind

Vision-centric autonomous driving systems rely on diverse and scalable training data to achieve robust performance. While video object editing offers a promising path for data augmentation, existing methods often struggle to maintain both…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Shuyun Wang , Haiyang Sun , Bing Wang , Hangjun Ye , Xin Yu

Autonomous vehicles (AVs) are expected to revolutionize transportation by improving efficiency and safety. Their success relies on 3D vision systems that effectively sense the environment and detect traffic agents. Among sensors AVs use to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Amirhesam Aghanouri , Cristina Olaverri-Monreal

Autonomous Vehicles (AVs) use natural images and videos as input to understand the real world by overlaying and inferring digital elements, facilitating proactive detection in an effort to assure safety. A crucial aspect of this process is…