中文
相关论文

相关论文: Ctrl123: Consistent Novel View Synthesis via Close…

200 篇论文

Existing real-time RGB-D reconstruction approaches, like Kinect Fusion, lack real-time photo-realistic visualization. This is due to noisy, oversmoothed or incomplete geometry and blurry textures which are fused from imperfect depth maps…

计算机视觉与模式识别 · 计算机科学 2023-11-30 Laura Fink , Darius Rückert , Linus Franke , Joachim Keinert , Marc Stamminger

Existing reconstruction-based novel view synthesis methods for driving scenes focus on synthesizing camera views along the recorded trajectory of the ego vehicle. Their image rendering performance will severely degrade on viewpoints falling…

计算机视觉与模式识别 · 计算机科学 2024-10-24 Qitai Wang , Lue Fan , Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang

Recent innovations on text-to-3D generation have featured Score Distillation Sampling (SDS), which enables the zero-shot learning of implicit 3D models (NeRF) by directly distilling prior knowledge from 2D diffusion models. However, current…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Yang Chen , Yingwei Pan , Haibo Yang , Ting Yao , Tao Mei

This paper presents a new dataset for Novel View Synthesis, generated from a high-quality, animated film with stunning realism and intricate detail. Our dataset captures a variety of dynamic scenes, complete with detailed textures,…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Michal Nazarczuk , Thomas Tanay , Arthur Moreau , Zhensong Zhang , Eduardo Pérez-Pellitero

Novel-view synthesis (NVS) approaches play a critical role in vast scene reconstruction. However, these methods rely heavily on dense image inputs and prolonged training times, making them unsuitable where computational resources are…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Hao Li , Yuanyuan Gao , Haosong Peng , Chenming Wu , Weicai Ye , Yufeng Zhan , Chen Zhao , Dingwen Zhang , Jingdong Wang , Junwei Han

We introduce an approach to enhance the novel view synthesis from images taken from a freely moving camera. The introduced approach focuses on outdoor scenes where recovering accurate geometric scaffold and camera pose is challenging,…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Nishant Jain , Suryansh Kumar , Luc Van Gool

We introduce HyperGS, a novel framework for Hyperspectral Novel View Synthesis (HNVS), based on a new latent 3D Gaussian Splatting (3DGS) technique. Our approach enables simultaneous spatial and spectral renderings by encoding material…

计算机视觉与模式识别 · 计算机科学 2024-12-18 Christopher Thirgood , Oscar Mendez , Erin Chao Ling , Jon Storey , Simon Hadfield

High Dynamic Range Novel View Synthesis (HDR-NVS) aims to establish a 3D scene HDR model from Low Dynamic Range (LDR) imagery. Typically, multiple-exposure LDR images are employed to capture a wider range of brightness levels in a scene, as…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Kaixuan Zhang , Hu Wang , Minxian Li , Mingwu Ren , Mao Ye , Xiatian Zhu

Recent advancements in diffusion and flow models have greatly improved text-based image editing, yet methods that edit images independently often produce geometrically and photometrically inconsistent results across different views of the…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Josef Bengtson , David Nilsson , Dong In Lee , Yaroslava Lochman , Fredrik Kahl

Prior approaches injecting camera control into diffusion models have focused on specific subsets of 4D consistency tasks: novel view synthesis, text-to-video with camera control, image-to-video, amongst others. Therefore, these fragmented…

计算机视觉与模式识别 · 计算机科学 2026-01-26 Xiang Fan , Sharath Girish , Vivek Ramanujan , Chaoyang Wang , Ashkan Mirzaei , Petr Sushko , Aliaksandr Siarohin , Sergey Tulyakov , Ranjay Krishna

Synthesizing novel views from a single view image is a highly ill-posed problem. We discover an effective solution to reduce the learning ambiguity by expanding the single-view view synthesis problem to a multi-view setting. Specifically,…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Yang Zhou , Hanjie Wu , Wenxi Liu , Zheng Xiong , Jing Qin , Shengfeng He

High dynamic range (HDR) novel view synthesis (NVS) aims to create photorealistic images from novel viewpoints using HDR imaging techniques. The rendered HDR images capture a wider range of brightness levels containing more details of the…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Yuanhao Cai , Zihao Xiao , Yixun Liang , Minghan Qin , Yulun Zhang , Xiaokang Yang , Yaoyao Liu , Alan Yuille

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-projected features but…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Zhizhuo Zhou , Shubham Tulsiani

Gaussian Splatting (GS) and Neural Radiance Fields (NeRF) are two groundbreaking technologies that have revolutionized the field of Novel View Synthesis (NVS), enabling immersive photorealistic rendering and user experiences by synthesizing…

计算机视觉与模式识别 · 计算机科学 2025-01-15 Yuhang Zhang , Joshua Maraval , Zhengyu Zhang , Nicolas Ramin , Shishun Tian , Lu Zhang

Text-based 2D diffusion models have demonstrated impressive capabilities in image generation and editing. Meanwhile, the 2D diffusion models also exhibit substantial potentials for 3D editing tasks. However, how to achieve consistent edits…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Ruihuang Li , Liyi Chen , Zhengqiang Zhang , Varun Jampani , Vishal M. Patel , Lei Zhang

Existing state-of-the-art novel view synthesis methods rely on either fairly accurate 3D geometry estimation or sampling of the entire space for neural volumetric rendering, which limit the overall efficiency. In order to improve the…

计算机视觉与模式识别 · 计算机科学 2022-04-08 Yuemei Zhou , Tao Yu , Zerong Zheng , Ying Fu , Yebin Liu

View synthesis is a process for generating novel views from a scene which has been recorded with a 3-D camera setup. It has important applications in 3-D post-production and 2-D to 3-D conversion. However, a central problem in the…

计算机视觉与模式识别 · 计算机科学 2014-06-25 Julian Habigt , Klaus Diepold

Accurate and efficient 3D reconstruction of trees is crucial for forest resource assessments and management. Close-Range Photogrammetry (CRP) is commonly used for reconstructing forest scenes but faces challenges like low efficiency and…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Guoji Tian , Chongcheng Chen , Hongyu Huang

Novel View Synthesis (NVS) is the task of generating new images of a scene from viewpoints that were not part of the original input. Diffusion-based NVS can generate high-quality, temporally consistent images, however, remains…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Yuchen Xia , Souvik Kundu , Mosharaf Chowdhury , Nishil Talati

The creation of lifelike human avatars capable of realistic pose variation and viewpoint flexibility remains a fundamental challenge in computer vision and graphics. Current approaches typically yield either geometrically inconsistent…

计算机视觉与模式识别 · 计算机科学 2025-12-10 Chia-Hern Lai , I-Hsuan Lo , Yen-Ku Yeh , Thanh-Nguyen Truong , Ching-Chun Huang