中文
相关论文

相关论文: Aug3D: Augmenting large scale outdoor datasets for…

200 篇论文

3D Gaussian splatting enables high-quality novel view synthesis (NVS) at real-time frame rates. However, its quality drops sharply as we depart from the training views. Thus, dense captures are needed to match the high-quality expectations…

Large transformer-based models have made significant progress in generalizable novel view synthesis (NVS) from sparse input views, generating novel viewpoints without the need for test-time optimization. However, these models are…

Scene-level novel view synthesis (NVS) is fundamental to many vision and graphics applications. Recently, pose-conditioned diffusion models have led to significant progress by extracting 3D information from 2D foundation models, but these…

计算机视觉与模式识别 · 计算机科学 2024-08-23 Joseph Tung , Gene Chou , Ruojin Cai , Guandao Yang , Kai Zhang , Gordon Wetzstein , Bharath Hariharan , Noah Snavely

Existing neural radiance fields (NeRF)-based novel view synthesis methods for large-scale outdoor scenes are mainly built on a single altitude. Moreover, they often require a priori camera shooting height and scene scope, leading to…

计算机视觉与模式识别 · 计算机科学 2024-04-19 Jingfeng Guo , Xiaohan Zhang , Baozhu Zhao , Qi Liu

In this work, we introduce UniGS, a novel 3D Gaussian reconstruction and novel view synthesis model that predicts a high-fidelity representation of 3D Gaussians from arbitrary number of posed sparse-view images. Previous methods often…

计算机视觉与模式识别 · 计算机科学 2025-04-02 Jiamin Wu , Kenkun Liu , Yukai Shi , Xiaoke Jiang , Yuan Yao , Lei Zhang

NeRF-based methods reconstruct 3D scenes by building a radiance field with implicit or explicit representations. While NeRF-based methods can perform novel view synthesis (NVS) at arbitrary scale, the performance in high-resolution novel…

计算机视觉与模式识别 · 计算机科学 2025-12-18 Ding-Jiun Huang , Zi-Ting Chou , Yu-Chiang Frank Wang , Cheng Sun

We introduce MVSplat360, a feed-forward approach for 360{\deg} novel view synthesis (NVS) of diverse real-world scenes, using only sparse observations. This setting is inherently ill-posed due to minimal overlap among input views and…

计算机视觉与模式识别 · 计算机科学 2024-11-08 Yuedong Chen , Chuanxia Zheng , Haofei Xu , Bohan Zhuang , Andrea Vedaldi , Tat-Jen Cham , Jianfei Cai

We present a novel framework for high-fidelity novel view synthesis (NVS) from sparse images, addressing key limitations in recent feed-forward 3D Gaussian Splatting (3DGS) methods built on Vision Transformer (ViT) backbones. While…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Yitong Dong , Qi Zhang , Minchao Jiang , Zhiqiang Wu , Qingnan Fan , Ying Feng , Huaqi Zhang , Hujun Bao , Guofeng Zhang

Recent 3D novel view synthesis (NVS) methods often require extensive 3D data for training, and also typically lack generalization beyond the training distribution. Moreover, they tend to be object centric and struggle with complex and…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Taewon Kang , Divya Kothandaraman , Dinesh Manocha , Ming C. Lin

Novel view synthesis (NVS) seeks to render photorealistic, 3D-consistent images of a scene from unseen camera poses given only a sparse set of posed views. Existing deterministic networks render observed regions quickly but blur unobserved…

计算机视觉与模式识别 · 计算机科学 2025-12-24 Thanh-Tung Le , Tuan Pham , Tung Nguyen , Deying Kong , Xiaohui Xie , Stephan Mandt

Neural rendering-based urban scene reconstruction methods commonly rely on images collected from driving vehicles with cameras facing and moving forward. Although these methods can successfully synthesize from views similar to training…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Sungwon Hwang , Min-Jung Kim , Taewoong Kang , Jayeon Kang , Jaegul Choo

Novel view synthesis (NVS) has advanced with generative modeling, enabling photorealistic image generation. In few-shot NVS, where only a few input views are available, existing methods often assume equal importance for all input views…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Alex Berian , JhihYang Wu , Daniel Brignac , Natnael Daba , Abhijit Mahalanobis

The field of novel view synthesis from images has seen rapid advancements with the introduction of Neural Radiance Fields (NeRF) and more recently with 3D Gaussian Splatting. Gaussian Splatting became widely adopted due to its efficiency…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Ruihong Yin , Vladimir Yugay , Yue Li , Sezer Karaoglu , Theo Gevers

Photographs captured in unstructured tourist environments frequently exhibit variable appearances and transient occlusions, challenging accurate scene reconstruction and inducing artifacts in novel view synthesis. Although prior approaches…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Jiacong Xu , Yiqun Mei , Vishal M. Patel

Reconstructing and semantically interpreting 3D scenes from sparse 2D views remains a fundamental challenge in computer vision. Conventional methods often decouple semantic understanding from reconstruction or necessitate costly per-scene…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Xiangyu Sun , Haoyi Jiang , Liu Liu , Seungtae Nam , Gyeongjin Kang , Xinjie Wang , Wei Sui , Zhizhong Su , Wenyu Liu , Xinggang Wang , Eunbyung Park

Novel view synthesis (NVS) aims to generate images at arbitrary viewpoints using multi-view images, and recent insights from neural radiance fields (NeRF) have contributed to remarkable improvements. Recently, studies on generalizable NeRF…

计算机视觉与模式识别 · 计算机科学 2024-10-02 Youngho Yoon , Hyun-Kurl Jang , Kuk-Jin Yoon

Novel-view synthesis aims to generate novel views of a scene from multiple input images or videos, and recent advancements like 3D Gaussian splatting (3DGS) have achieved notable success in producing photorealistic renderings with efficient…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Xi Liu , Chaoyi Zhou , Siyu Huang

We propose DistillNeRF, a self-supervised learning framework addressing the challenge of understanding 3D environments from limited 2D observations in outdoor autonomous driving scenes. Our method is a generalizable feedforward model that…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Letian Wang , Seung Wook Kim , Jiawei Yang , Cunjun Yu , Boris Ivanovic , Steven L. Waslander , Yue Wang , Sanja Fidler , Marco Pavone , Peter Karkus

Novel view synthesis (NVS) is a challenging task requiring systems to generate photorealistic images of scenes from new viewpoints, where both quality and speed are important for applications. Previous image-based rendering (IBR) methods…

计算机视觉与模式识别 · 计算机科学 2022-08-08 Ang Cao , Chris Rockwell , Justin Johnson

We propose UpFusion, a system that can perform novel view synthesis and infer 3D representations for an object given a sparse set of reference images without corresponding pose information. Current sparse-view 3D inference methods typically…

计算机视觉与模式识别 · 计算机科学 2024-01-05 Bharath Raj Nagoor Kani , Hsin-Ying Lee , Sergey Tulyakov , Shubham Tulsiani