English
Related papers

Related papers: Echo-Reconstruction: Audio-Augmented 3D Scene Reco…

200 papers

Recovering the radiometric properties of a scene (i.e., the reflectance, illumination, and geometry) is a long-sought ability of computer vision that can provide invaluable information for a wide range of applications. Deciphering the…

Computer Vision and Pattern Recognition · Computer Science 2016-04-06 Stephen Lombardi , Ko Nishino

This paper focuses on perceiving and navigating 3D environments using echoes and RGB image. In particular, we perform depth estimation by fusing RGB image with echoes, received from multiple orientations. Unlike previous works, we go beyond…

Computer Vision and Pattern Recognition · Computer Science 2024-02-12 Lingyu Zhu , Esa Rahtu , Hang Zhao

Event cameras are rapidly emerging as powerful vision sensors for 3D reconstruction, uniquely capable of asynchronously capturing per-pixel brightness changes. Compared to traditional frame-based cameras, event cameras produce sparse yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Chuanzhi Xu , Haoxian Zhou , Langyi Chen , Haodong Chen , Zeke Zexi Hu , Zhicheng Lu , Ying Zhou , Vera Chung , Qiang Qu , Weidong Cai

Inferring the 3D shape of an object from an RGB image has shown impressive results, however, existing methods rely primarily on recognizing the most similar 3D model from the training set to solve the problem. These methods suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Haozhe Xie , Hongxun Yao , Shangchen Zhou , Shengping Zhang , Xiaoshuai Sun , Wenxiu Sun

Recovering textured 3D models of non-rigid human body shapes is challenging due to self-occlusions caused by complex body poses and shapes, clothing obstructions, lack of surface texture, background clutter, sparse set of cameras with…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Abbhinav Venkat , Sai Sagar Jinka , Avinash Sharma

Room geometry inference algorithms rely on the localization of acoustic reflectors to identify boundary surfaces of an enclosure. Rooms with highly absorptive walls or walls at large distances from the measurement setup pose challenges for…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-12 H. Nazim Bicer , Cagdas Tuna , Andreas Walther , Emanuël A. P. Habets

Reconstructing real-world 3D objects has numerous applications in computer vision, such as virtual reality, video games, and animations. Ideally, 3D reconstruction methods should generate high-fidelity results with 3D consistency in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Jingnan Gao , Zhuo Chen , Yichao Yan , Bowen Pan , Zhe Wang , Jiangjing Lyu , Xiaokang Yang

Reflections in videos are obstructions that often occur when videos are taken behind reflective surfaces like glass. These reflections reduce the quality of such videos, lead to information loss and degrade the accuracy of many computer…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Amgad Ahmed , Suhong Kim , Mohamed Elgharib , Mohamed Hefeeda

Narrated instructional videos often show and describe manipulations of similar objects, e.g., repairing a particular model of a car or laptop. In this work we aim to reconstruct such objects and to localize associated narrations in 3D.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Dimitri Zhukov , Ignacio Rocco , Ivan Laptev , Josef Sivic , Johannes L. Schönberger , Bugra Tekin , Marc Pollefeys

Digitizing the physical world into accurate simulation-ready virtual environments offers significant opportunities in a variety of fields such as augmented and virtual reality, gaming, and robotics. However, current 3D reconstruction and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Hongchi Xia , Chih-Hao Lin , Hao-Yu Hsu , Quentin Leboutet , Katelyn Gao , Michael Paulitsch , Benjamin Ummenhofer , Shenlong Wang

Accurately rendering scenes with reflective surfaces remains a significant challenge in novel view synthesis, as existing methods like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) often misinterpret reflections as physical…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Jiayi Song , Zihan Ye , Qingyuan Zhou , Weidong Yang , Ben Fei , Jingyi Xu , Ying He , Wanli Ouyang

Recovering the 3D representation of an object from single-view or multi-view RGB images by deep neural networks has attracted increasing attention in the past few years. Several mainstream works (e.g., 3D-R2N2) use recurrent neural networks…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Haozhe Xie , Hongxun Yao , Xiaoshuai Sun , Shangchen Zhou , Shengping Zhang

We propose a novel explicit dense 3D reconstruction approach that processes a set of images of a scene with sensor poses and calibrations and estimates a photo-real digital model. One of the key innovations is that the underlying volumetric…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Samir Aroudj , Steven Lovegrove , Eddy Ilg , Tanner Schmidt , Michael Goesele , Richard Newcombe

3D reconstruction is a fundamental task in robotics that gained attention due to its major impact in a wide variety of practical settings, including agriculture, underwater, and urban environments. This task can be carried out via view…

Recently, it has been shown that a high resolution image can be obtained without the usage of a high resolution sensor. The main idea has been that a low resolution sensor is covered with a non-regular sampling mask followed by a…

Image and Video Processing · Electrical Eng. & Systems 2022-04-11 Markus Jonscher , Jürgen Seiler , Michel Bätz , Thomas Richter , Wolfgang Schnurrer , André Kaup

3D scene reconstruction is a long-standing vision task. Existing approaches can be categorized into geometry-based and learning-based methods. The former leverages multi-view geometry but can face catastrophic failures due to the reliance…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Guangkai Xu , Wei Yin , Hao Chen , Chunhua Shen , Kai Cheng , Feng Zhao

Echo-location is a broad approach to imaging and sensing that includes both man-made RADAR, LIDAR, SONAR and also animal navigation. However, full 3D information based on echo-location requires some form of scanning of the scene in order to…

Image and Video Processing · Electrical Eng. & Systems 2021-06-16 Alex Turpin , Valentin Kapitany , Jack Radford , Davide Rovelli , Kevin Mitchell , Ashley Lyons , Ilya Starshynov , Daniele Faccio

With active research in audio compression techniques yielding substantial breakthroughs, spectral reconstruction of low-quality audio waves remains a less indulged topic. In this paper, we propose a novel approach for reconstructing higher…

Sound · Computer Science 2021-08-10 Darshan Deshpande , Harshavardhan Abichandani

Interactive 3D scenes are increasingly vital for embodied intelligence, yet existing datasets remain limited due to the labor-intensive process of annotating part segmentation, kinematic types, and motion trajectories. We present REACT3D, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Zhao Huang , Boyang Sun , Alexandros Delitzas , Jiaqi Chen , Marc Pollefeys

Reconstruction of 3D scenes from 2D images is a technical challenge that impacts domains from Earth and planetary sciences and space exploration to augmented and virtual reality. Typically, reconstruction algorithms first identify common…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Racquel Fygenson , Kazi Jawad , Isabel Li , Francois Ayoub , Robert G. Deen , Scott Davidoff , Dominik Moritz , Mauricio Hess-Flores