English
Related papers

Related papers: CodedStereo: Learned Phase Masks for Large Depth-o…

200 papers

Real world applications of stereo depth estimation require models that are robust to dynamic variations in the environment. Even though deep learning based stereo methods are successful, they often fail to generalize to unseen variations in…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Alessio Tonioni , Oscar Rahnama , Thomas Joy , Luigi Di Stefano , Thalaiyasingam Ajanthan , Philip H. S. Torr

Point-spread-function (PSF) engineering is a well-established computational imaging technique that uses phase masks and other optical elements to embed extra information (e.g., depth) into the images captured by conventional CMOS image…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Sachin Shah , Matthew Albert Chan , Haoming Cai , Jingxi Chen , Sakshum Kulshrestha , Chahat Deep Singh , Yiannis Aloimonos , Christopher Metzler

The photometric stereo (PS) problem consists in reconstructing the 3D-surface of an object, thanks to a set of photographs taken under different lighting directions. In this paper, we propose a multi-scale architecture for PS which,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Clément Hardy , Yvain Quéau , David Tschumperlé

This paper presents an uncalibrated deep neural network framework for the photometric stereo problem. For training models to solve the problem, existing neural network-based methods either require exact light directions or ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Berk Kaya , Suryansh Kumar , Carlos Oliveira , Vittorio Ferrari , Luc Van Gool

3D-shape reconstruction in extreme environments, such as low illumination or scattering condition, has been an open problem and intensively researched. Active stereo is one of potential solution for such environments for its robustness and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Kazuto Ichimaru , Takaki Ikeda , Diego Thomas , Takafumi Iwaguchi , Hiroshi Kawasaki

Stereo matching is a key technique for metric depth estimation in computer vision and robotics. Real-world challenges like occlusion and non-texture hinder accurate disparity estimation from binocular matching cues. Recently, monocular…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Hualie Jiang , Zhiqiang Lou , Laiyan Ding , Rui Xu , Minglang Tan , Wenjie Jiang , Rui Huang

Photometric Stereo methods seek to reconstruct the 3d shape of an object from motionless images obtained with varying illumination. Most existing methods solve a restricted problem where the physical reflectance model, such as Lambertian…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Ofer Bartal , Nati Ofir , Yaron Lipman , Ronen Basri

Most deep learning-based models for speech enhancement have mainly focused on estimating the magnitude of spectrogram while reusing the phase from noisy speech for reconstruction. This is due to the difficulty of estimating the phase of…

Sound · Computer Science 2019-04-03 Hyeong-Seok Choi , Jang-Hyun Kim , Jaesung Huh , Adrian Kim , Jung-Woo Ha , Kyogu Lee

In recent years, deep networks have led to dramatic improvements in speech enhancement by framing it as a data-driven pattern recognition problem. In many modern enhancement systems, large amounts of data are used to train a deep network to…

Unlike single image task, stereo image enhancement can use another view information, and its key stage is how to perform cross-view feature interaction to extract useful information from another view. However, complex noise in low-light…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Minghua Zhao , Xiangdong Qin , Shuangli Du , Xuefei Bai , Jiahao Lyu , Yiguang Liu

We present Multiscale Audio Spectrogram Transformer (MAST) for audio classification, which brings the concept of multiscale feature hierarchies to the Audio Spectrogram Transformer (AST). Given an input audio spectrogram, we first patchify…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-19 Sreyan Ghosh , Ashish Seth , S. Umesh , Dinesh Manocha

Recent video depth estimation methods achieve great performance by following the paradigm of image depth estimation, i.e., typically fine-tuning pre-trained video diffusion models with massive data. However, we argue that video depth…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Haodong Li , Chen Wang , Jiahui Lei , Kostas Daniilidis , Lingjie Liu

Several leading methods on public benchmarks for depth-from-stereo rely on memory-demanding 4D cost volumes and computationally intensive 3D convolutions for feature matching. We suggest a new way to process the 4D cost volume where we…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Oh-Hun Kwon , Eduard Zell

We introduce a novel framework for training deep stereo networks effortlessly and without any ground-truth. By leveraging state-of-the-art neural rendering solutions, we generate stereo training data from image sequences collected with a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Fabio Tosi , Alessio Tonioni , Daniele De Gregorio , Matteo Poggi

Photometric stereo is a technique for estimating surface normals using images captured under varying illumination. However, conventional frame-based photometric stereo methods are limited in real-world applications due to their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hyunwoo Kim , Won-Hoe Kim , Sanghoon Lee , Jianfei Cai , Giljoo Nam , Jae-Sang Hyun

This work presents dense stereo reconstruction using high-resolution images for infrastructure inspections. The state-of-the-art stereo reconstruction methods, both learning and non-learning ones, consume too much computational resource on…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Yaoyu Hu , Weikun Zhen , Sebastian Scherer

Stereo is a prominent technique to infer dense depth maps from images, and deep learning further pushed forward the state-of-the-art, making end-to-end architectures unrivaled when enough data is available for training. However, deep…

Computer Vision and Pattern Recognition · Computer Science 2019-05-27 Matteo Poggi , Davide Pallotti , Fabio Tosi , Stefano Mattoccia

Lensless cameras provide a framework to build thin imaging systems by replacing the lens in a conventional camera with an amplitude or phase mask near the sensor. Existing methods for lensless imaging can recover the depth and intensity of…

Image and Video Processing · Electrical Eng. & Systems 2021-08-19 Yucheng Zheng , Yi Hua , Aswin C. Sankaranarayanan , M. Salman Asif

Stereo matching provides depth estimation from binocular images for downstream applications. These applications mostly take video streams as input and require temporally consistent depth maps. However, existing methods mainly focus on the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Jiaxi Zeng , Chengtang Yao , Yuwei Wu , Yunde Jia

Photoacoustic microscopy with large depth of focus is significant to the biomedical research. The conventional optical-resolution photoacoustic microscope (OR-PAM) suffers from limited depth of field (DoF) since the employed focused…

Image and Video Processing · Electrical Eng. & Systems 2020-09-07 Xianlin Song , Jianshuang Wei , Lingfang Song