English
Related papers

Related papers: HITNet: Hierarchical Iterative Tile Refinement Net…

200 papers

We present a method for extracting depth information from a rectified image pair. Our approach focuses on the first stage of many stereo algorithms: the matching cost computation. We approach the problem by learning a similarity measure on…

Computer Vision and Pattern Recognition · Computer Science 2016-05-19 Jure Žbontar , Yann LeCun

Despite the remarkable progress of deep learning in stereo matching, there exists a gap in accuracy between real-time models and slower state-of-the-art models which are suitable for practical applications. This paper presents an iterative…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Kumail Raza , René Schuster , Didier Stricker

Real-time Stereo Matching is a cornerstone algorithm for many Extended Reality (XR) applications, such as indoor 3D understanding, video pass-through, and mixed-reality games. Despite significant advancements in deep stereo methods,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Ziang Cheng , Jiayu Yang , Hongdong Li

Deep convolutional neural networks trained end-to-end are the state-of-the-art methods to regress dense disparity maps from stereo pairs. These models, however, suffer from a notable decrease in accuracy when exposed to scenarios…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Alessio Tonioni , Fabio Tosi , Matteo Poggi , Stefano Mattoccia , Luigi Di Stefano

We present three multi-scale similarity learning architectures, or DeepSim networks. These models learn pixel-level matching with a contrastive loss and are agnostic to the geometry of the considered scene. We establish a middle ground…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Mohamed Ali Chebbi , Ewelina Rupnik , Marc Pierrot-Deseilligny , Paul Lopes

3D human pose estimation errors would propagate along the human body topology and accumulate at the end joints of limbs. Inspired by the backtracking mechanism in automatic control systems, we design an Intra-Part Constraint module that…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Jialun Cai , Hong Liu , Runwei Ding , Wenhao Li , Jianbing Wu , Miaoju Ban

With the rapid development of smart manufacturing, data-driven machinery health management has been of growing attention. In situations where some classes are more difficult to be distinguished compared to others and where classes might be…

Stereo correspondence matching is an essential part of the multi-step stereo depth estimation process. This paper revisits the depth estimation problem, avoiding the explicit stereo matching step using a simple two-tower convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Rohit Choudhary , Mansi Sharma , Rithvik Anil

Supervised deep networks are among the best methods for finding correspondences in stereo image pairs. Like all supervised approaches, these networks require ground truth data during training. However, collecting large quantities of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-24 Jamie Watson , Oisin Mac Aodha , Daniyar Turmukhambetov , Gabriel J. Brostow , Michael Firman

Under stereo settings, the problem of image super-resolution (SR) and disparity estimation are interrelated that the result of each problem could help to solve the other. The effective exploitation of correspondence between different views…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 Qinyan Dai , Juncheng Li , Qiaosi Yi , Faming Fang , Guixu Zhang

End-to-end deep-learning networks recently demonstrated extremely good perfor- mance for stereo matching. However, existing networks are difficult to use for practical applications since (1) they are memory-hungry and unable to process even…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Stepan Tulyakov , Anton Ivanov , Francois Fleuret

Stereo matching is a fundamental task in scene comprehension. In recent years, the method based on iterative optimization has shown promise in stereo matching. However, the current iteration framework employs a single-peak lookup, which…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Miaojie Feng , Junda Cheng , Hao Jia , Longliang Liu , Gangwei Xu , Qingyong Hu , Xin Yang

Stereo matching is an essential basis for various applications, but most stereo matching methods have poor generalization performance and require a fixed disparity search range. Moreover, current stereo matching methods focus on the scenes…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Jiazhi Liu , Feng Liu

Depth estimation from a stereo image pair has become one of the most explored applications in computer vision, with most of the previous methods relying on fully supervised learning settings. However, due to the difficulty in acquiring…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Baoru Huang , Jian-Qing Zheng , Stamatia Giannarou , Daniel S. Elson

Self-supervised learning for depth estimation possesses several advantages over supervised learning. The benefits of no need for ground-truth depth, online fine-tuning, and better generalization with unlimited data attract researchers to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Weihao Yuan , Yazhan Zhang , Bingkun Wu , Siyu Zhu , Ping Tan , Michael Yu Wang , Qifeng Chen

Recent methods in stereo matching have continuously improved the accuracy using deep models. This gain, however, is attained with a high increase in computation cost, such that the network may not fit even on a moderate GPU. This issue…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Faranak Shamsafar , Samuel Woerz , Rafia Rahim , Andreas Zell

Scene understanding is paramount in robotics, self-navigation, augmented reality, and many other fields. To fully accomplish this task, an autonomous agent has to infer the 3D structure of the sensed scene (to know where it looks at) and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Pier Luigi Dovesi , Matteo Poggi , Lorenzo Andraghetti , Miquel Martí , Hedvig Kjellström , Alessandro Pieropan , Stefano Mattoccia

To obtain high-resolution depth maps, some previous learning-based multi-view stereo methods build a cost volume pyramid in a coarse-to-fine manner. These approaches leverage fixed depth range hypotheses to construct cascaded plane sweep…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Puyuan Yi , Shengkun Tang , Jian Yao

We introduce RAFT-Stereo, a new deep architecture for rectified stereo based on the optical flow network RAFT. We introduce multi-level convolutional GRUs, which more efficiently propagate information across the image. A modified version of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Lahav Lipson , Zachary Teed , Jia Deng

In this paper, we propose an efficient and effective dense hybrid recurrent multi-view stereo net with dynamic consistency checking, namely $D^{2}$HC-RMVSNet, for accurate dense point cloud reconstruction. Our novel hybrid recurrent…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Jianfeng Yan , Zizhuang Wei , Hongwei Yi , Mingyu Ding , Runze Zhang , Yisong Chen , Guoping Wang , Yu-Wing Tai