中文
相关论文

相关论文: Novel View Synthesis via Depth-guided Skip Connect…

200 篇论文

The field of novel view synthesis from images has seen rapid advancements with the introduction of Neural Radiance Fields (NeRF) and more recently with 3D Gaussian Splatting. Gaussian Splatting became widely adopted due to its efficiency…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Ruihong Yin , Vladimir Yugay , Yue Li , Sezer Karaoglu , Theo Gevers

Novel view synthesis for dynamic scenes is still a challenging problem in computer vision and graphics. Recently, Gaussian splatting has emerged as a robust technique to represent static scenes and enable high-quality and real-time novel…

计算机视觉与模式识别 · 计算机科学 2024-04-15 Yi-Hua Huang , Yang-Tian Sun , Ziyi Yang , Xiaoyang Lyu , Yan-Pei Cao , Xiaojuan Qi

3D Gaussian splatting enables high-quality novel view synthesis (NVS) at real-time frame rates. However, its quality drops sharply as we depart from the training views. Thus, dense captures are needed to match the high-quality expectations…

Depth-image-based rendering is a key view synthesis algorithm in 3D video systems, which enables the synthesis of virtual views from texture images and depth maps. An efficient view synthesis distortion estimation model is critical for…

图像与视频处理 · 电气工程与系统科学 2025-10-21 Chongyuan Bi , Jie Liang

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

We present Neural Pixel Composition (NPC), a novel approach for continuous 3D-4D view synthesis given only a discrete set of multi-view observations as input. Existing state-of-the-art approaches require dense multi-view supervision and an…

计算机视觉与模式识别 · 计算机科学 2022-07-22 Aayush Bansal , Michael Zollhoefer

In this paper, we introduce RED-NET: A Recursive Encoder-Decoder Network with Skip-Connections for edge detection in natural images. The proposed network is a novel integration of a Recursive Neural Network with an Encoder-Decoder…

计算机视觉与模式识别 · 计算机科学 2019-12-09 Truc Le , Yuyan Li , Ye Duan

We propose an optical flow-guided approach for semi-supervised video object segmentation. Optical flow is usually exploited as additional guidance information in unsupervised video object segmentation. However, its relevance in…

计算机视觉与模式识别 · 计算机科学 2023-01-26 Yushan Zhang , Andreas Robinson , Maria Magnusson , Michael Felsberg

Novel view synthesis from an in-the-wild video is difficult due to challenges like scene dynamics and lack of parallax. While existing methods have shown promising results with implicit neural radiance fields, they are slow to train and…

计算机视觉与模式识别 · 计算机科学 2024-07-22 Yao-Chih Lee , Zhoutong Zhang , Kevin Blackburn-Matzen , Simon Niklaus , Jianming Zhang , Jia-Bin Huang , Feng Liu

Single-image novel view synthesis is a challenging and ongoing problem that aims to generate an infinite number of consistent views from a single input image. Although significant efforts have been made to advance the quality of generated…

计算机视觉与模式识别 · 计算机科学 2023-12-19 Guo Pu , Peng-Shuai Wang , Zhouhui Lian

With the introduction of consumer light field cameras, light field imaging has recently become widespread. However, there is an inherent trade-off between the angular and spatial resolution, and thus, these cameras often sparsely sample in…

计算机视觉与模式识别 · 计算机科学 2016-09-13 Nima Khademi Kalantari , Ting-Chun Wang , Ravi Ramamoorthi

Recent advancements in differentiable rendering and 3D reasoning have driven exciting results in novel view synthesis from a single image. Despite realistic results, methods are limited to relatively small view change. In order to…

计算机视觉与模式识别 · 计算机科学 2021-08-13 Chris Rockwell , David F. Fouhey , Justin Johnson

Recent advancements in view synthesis have significantly enhanced immersive experiences across various computer graphics and multimedia applications, including telepresence and entertainment. By enabling the generation of new perspectives…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Manu Gond , Emin Zerman , Sebastian Knorr , Mårten Sjöström

We introduce an approach to enhance the novel view synthesis from images taken from a freely moving camera. The introduced approach focuses on outdoor scenes where recovering accurate geometric scaffold and camera pose is challenging,…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Nishant Jain , Suryansh Kumar , Luc Van Gool

We present a method that achieves state-of-the-art results for synthesizing novel views of complex scenes by optimizing an underlying continuous volumetric scene function using a sparse set of input views. Our algorithm represents a scene…

计算机视觉与模式识别 · 计算机科学 2020-08-05 Ben Mildenhall , Pratul P. Srinivasan , Matthew Tancik , Jonathan T. Barron , Ravi Ramamoorthi , Ren Ng

The field of novel view synthesis has made significant strides thanks to the development of radiance field methods. However, most radiance field techniques are far better at novel view interpolation than novel view extrapolation where the…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Kunhao Liu , Ling Shao , Shijian Lu

Building upon the recent progress in novel view synthesis, we propose its application to improve monocular depth estimation. In particular, we propose a novel training method split in three main steps. First, the prediction results of a…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Zuria Bauer , Zuoyue Li , Sergio Orts-Escolano , Miguel Cazorla , Marc Pollefeys , Martin R. Oswald

We explore novel-view synthesis for dynamic scenes from monocular videos. Prior approaches rely on costly test-time optimization of 4D representations or do not preserve scene geometry when trained in a feed-forward manner. Our approach is…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Kaihua Chen , Tarasha Khurana , Deva Ramanan

We propose a learning-based approach for novel view synthesis for multi-camera 360$^{\circ}$ panorama capture rigs. Previous work constructs RGBD panoramas from such data, allowing for view synthesis with small amounts of translation, but…

计算机视觉与模式识别 · 计算机科学 2020-08-06 Kai-En Lin , Zexiang Xu , Ben Mildenhall , Pratul P. Srinivasan , Yannick Hold-Geoffroy , Stephen DiVerdi , Qi Sun , Kalyan Sunkavalli , Ravi Ramamoorthi

Evaluating the perceptual quality of Novel View Synthesis (NVS) images remains a key challenge, particularly in the absence of pixel-aligned ground truth references. Full-Reference Image Quality Assessment (FR-IQA) methods fail under…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Abhijay Ghildyal , Rajesh Sureddi , Nabajeet Barman , Saman Zadtootaghaj , Alan Bovik