English
Related papers

Related papers: AV-Surf: Surface-Enhanced Geometry-Aware Novel-Vie…

200 papers

We present SetDiff, a geometry-grounded multi-view diffusion framework that enhances novel-view renderings produced by 3D Gaussian Splatting. Our method integrates explicit 3D priors, pixel-aligned coordinate maps and pose-aware Plucker ray…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Farhad G. Zanjani , Hong Cai , Amirhossein Habibian

We present a novel geometric deep learning method to compute the acoustic scattering properties of geometric objects. Our learning algorithm uses a point cloud representation of objects to compute the scattering properties and integrates…

Sound · Computer Science 2021-05-19 Hsien-Yu Meng , Zhenyu Tang , Dinesh Manocha

NeRFs have achieved incredible success in novel view synthesis. However, the accuracy of the implicit geometry is unsatisfactory because the passive static environmental illumination has low spatial frequency and cannot provide enough…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Jianyu Tao , Changping Hu , Edward Yang , Jing Xu , Rui Chen

We propose a novel framework for diffusion-based novel view synthesis in which we leverage external representations as conditions, harnessing their geometric and semantic correspondence properties for enhanced geometric consistency in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Min-Seop Kwak , Minkyung Kwon , Jinhyeok Choi , Jiho Park , Seungryong Kim

Since the advent of Neural Radiance Fields, novel view synthesis has received tremendous attention. The existing approach for the generalization of radiance field reconstruction primarily constructs an encoding volume from nearby source…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Jingliang Li , Qiang Zhou , Chaohui Yu , Zhengda Lu , Jun Xiao , Zhibin Wang , Fan Wang

Generalisation to unseen contexts remains a challenge for embodied navigation agents. In the context of semantic audio-visual navigation (SAVi) tasks, the notion of generalisation should include both generalising to unseen indoor visual…

Robotics · Computer Science 2022-12-23 Gyan Tatiya , Jonathan Francis , Luca Bondi , Ingrid Navarro , Eric Nyberg , Jivko Sinapov , Jean Oh

Novel view synthesis (NVS) is a challenging task in computer vision that involves synthesizing new views of a scene from a limited set of input images. Neural Radiance Fields (NeRF) have emerged as a powerful approach to address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Shuja Khalid , Frank Rudzicz

3D Gaussian Splatting (3DGS) represents a significant advancement in the field of efficient and high-fidelity novel view synthesis. Despite recent progress, achieving accurate geometric reconstruction under sparse-view conditions remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Zexu Huang , Min Xu , Stuart Perry

Room acoustic synthesis can be used in Virtual Reality (VR), Augmented Reality (AR) and gaming applications to enhance listeners' sense of immersion, realism and externalisation. A common approach is to use Geometrical Acoustics (GA) models…

Sound · Computer Science 2024-07-30 Matteo Scerbo , Lauri Savioja , Enzo De Sena

Robust audio-visual speech recognition (AVSR) in noisy environments remains challenging, as existing systems struggle to estimate audio reliability and dynamically adjust modality reliance. We propose router-gated cross-modal feature…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 DongHoon Lim , YoungChae Kim , Dong-Hyun Kim , Da-Hee Yang , Joon-Hyuk Chang

We present NeRFVS, a novel neural radiance fields (NeRF) based method to enable free navigation in a room. NeRF achieves impressive performance in rendering images for novel views similar to the input views while suffering for novel views…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Chen Yang , Peihao Li , Zanwei Zhou , Shanxin Yuan , Bingbing Liu , Xiaokang Yang , Weichao Qiu , Wei Shen

We propose DAVIS, a Diffusion-based Audio-VIsual Separation framework that solves the audio-visual sound source separation task through generative learning. Existing methods typically frame sound separation as a mask-based regression…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Chao Huang , Susan Liang , Yapeng Tian , Anurag Kumar , Chenliang Xu

Modern optical satellite sensors enable high-resolution stereo reconstruction from space. But the challenging imaging conditions when observing the Earth from space push stereo matching to its limits. In practice, the resulting digital…

Image and Video Processing · Electrical Eng. & Systems 2021-12-21 Corinne Stucker , Konrad Schindler

Novel view synthesis is an important problem with many applications, including AR/VR, gaming, and robotic simulations. With the recent rapid development of Neural Radiance Fields (NeRFs) and 3D Gaussian Splatting (3DGS) methods, it is…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Jonas Kulhanek , Torsten Sattler

We present NVSim, a framework that automatically constructs large-scale, navigable indoor simulators from only common image sequences, overcoming the cost and scalability limitations of traditional 3D scanning. Our approach adapts 3D…

Robotics · Computer Science 2025-10-29 Mingyu Jeong , Eunsung Kim , Sehun Park , Andrew Jaeyong Choi

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

Object-centric surface reconstruction from multi-view images is crucial in creating editable digital assets for AR/VR. Due to the lack of geometric constraints, existing methods, e.g., NeuS necessitate annotating the object masks to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Haotian Bai , Yize Chen , Lin Wang

Neural implicit reconstruction via volume rendering has demonstrated its effectiveness in recovering dense 3D surfaces. However, it is non-trivial to simultaneously recover meticulous geometry and preserve smoothness across regions with…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Ziyu Tang , Weicai Ye , Yifan Wang , Di Huang , Hujun Bao , Tong He , Guofeng Zhang

This paper describes the Qualcomm AI Research solution to the RealADSim-NVS challenge, hosted at the RealADSim Workshop at ICCV 2025. The challenge concerns novel view synthesis in street scenes, and participants are required to generate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Mohamed Omran , Farhad Zanjani , Davide Abati , Jens Petersen , Amirhossein Habibian

Achieving high-fidelity 3D surface reconstruction while preserving fine details remains challenging, especially in the presence of materials with complex reflectance properties and without a dense-view setup. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Robin Bruneau , Baptiste Brument , Yvain Quéau , Jean Mélou , François Bernard Lauze , Jean-Denis Durou , Lilian Calvet